Apr 14 10:36:17 user devstack@n-api.service[61838]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 14 10:36:17 user devstack@n-api.service[61838]: *** Starting uWSGI 2.0.20-debian (64bit) on [Fri Apr 14 10:36:17 2023] *** Apr 14 10:36:17 user devstack@n-api.service[61838]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 14 10:36:17 user devstack@n-api.service[61838]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 14 10:36:17 user devstack@n-api.service[61838]: nodename: user Apr 14 10:36:17 user devstack@n-api.service[61838]: machine: x86_64 Apr 14 10:36:17 user devstack@n-api.service[61838]: clock source: unix Apr 14 10:36:17 user devstack@n-api.service[61838]: pcre jit disabled Apr 14 10:36:17 user devstack@n-api.service[61838]: detected number of CPU cores: 12 Apr 14 10:36:17 user devstack@n-api.service[61838]: current working directory: / Apr 14 10:36:17 user devstack@n-api.service[61838]: detected binary path: /usr/bin/uwsgi-core Apr 14 10:36:17 user devstack@n-api.service[61838]: your processes number limit is 63637 Apr 14 10:36:17 user devstack@n-api.service[61838]: your memory page size is 4096 bytes Apr 14 10:36:17 user devstack@n-api.service[61838]: detected max file descriptor number: 2048 Apr 14 10:36:17 user devstack@n-api.service[61838]: lock engine: pthread robust mutexes Apr 14 10:36:17 user devstack@n-api.service[61838]: thunder lock: enabled Apr 14 10:36:17 user devstack@n-api.service[61838]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 14 10:36:17 user devstack@n-api.service[61838]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 14 10:36:17 user devstack@n-api.service[61838]: Python main interpreter initialized at 0x5579c7724990 Apr 14 10:36:17 user devstack@n-api.service[61838]: python threads support enabled Apr 14 10:36:17 user devstack@n-api.service[61838]: your server socket listen backlog is limited to 100 connections Apr 14 10:36:17 user devstack@n-api.service[61838]: your mercy for graceful operations on workers is 90 seconds Apr 14 10:36:17 user devstack@n-api.service[61838]: mapped 537436 bytes (524 KB) for 3 cores Apr 14 10:36:17 user devstack@n-api.service[61838]: *** Operational MODE: preforking *** Apr 14 10:36:17 user devstack@n-api.service[61838]: *** uWSGI is running in multiple interpreter mode *** Apr 14 10:36:17 user devstack@n-api.service[61838]: spawned uWSGI master process (pid: 61838) Apr 14 10:36:17 user devstack@n-api.service[61838]: spawned uWSGI worker 1 (pid: 61839, cores: 1) Apr 14 10:36:17 user devstack@n-api.service[61838]: spawned uWSGI worker 2 (pid: 61840, cores: 1) Apr 14 10:36:17 user devstack@n-api.service[61838]: spawned uWSGI worker 3 (pid: 61841, cores: 1) Apr 14 10:36:17 user devstack@n-api.service[61838]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 14 10:36:18 user devstack@n-api.service[61840]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 10:36:18 user devstack@n-api.service[61839]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 10:36:18 user devstack@n-api.service[61841]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 10:36:21 user devstack@n-api.service[61840]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 10:36:21 user devstack@n-api.service[61840]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 10:36:21 user devstack@n-api.service[61840]: and ``live_migration_inbound_addr`` respectively. Apr 14 10:36:21 user devstack@n-api.service[61840]: ). Its value may be silently ignored in the future. Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 10:36:21 user devstack@n-api.service[61841]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 10:36:21 user devstack@n-api.service[61841]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 10:36:21 user devstack@n-api.service[61841]: and ``live_migration_inbound_addr`` respectively. Apr 14 10:36:21 user devstack@n-api.service[61841]: ). Its value may be silently ignored in the future. Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 10:36:22 user devstack@n-api.service[61839]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 10:36:22 user devstack@n-api.service[61839]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 10:36:22 user devstack@n-api.service[61839]: and ``live_migration_inbound_addr`` respectively. Apr 14 10:36:22 user devstack@n-api.service[61839]: ). Its value may be silently ignored in the future. Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61841) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61840) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61839) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 10:36:22 user devstack@n-api.service[61841]: INFO dbcounter [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] Registered counter for database nova_api Apr 14 10:36:22 user devstack@n-api.service[61840]: INFO dbcounter [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] Registered counter for database nova_api Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG oslo_db.sqlalchemy.engines [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61841) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG oslo_db.sqlalchemy.engines [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61840) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writer thread running {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writer thread running {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 10:36:22 user devstack@n-api.service[61839]: INFO dbcounter [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Registered counter for database nova_api Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.context [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),93e1f09b-7316-4d89-8ce4-b495a7808f8e(cell1) {{(pid=61841) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG nova.context [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),93e1f09b-7316-4d89-8ce4-b495a7808f8e(cell1) {{(pid=61840) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:36:22 user devstack@n-api.service[61841]: INFO dbcounter [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] Registered counter for database nova_cell0 Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:36:22 user devstack@n-api.service[61841]: INFO dbcounter [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] Registered counter for database nova_cell1 Apr 14 10:36:22 user devstack@n-api.service[61840]: INFO dbcounter [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] Registered counter for database nova_cell0 Apr 14 10:36:22 user devstack@n-api.service[61840]: INFO dbcounter [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] Registered counter for database nova_cell1 Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG oslo_db.sqlalchemy.engines [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61841) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG oslo_db.sqlalchemy.engines [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61839) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG oslo_db.sqlalchemy.engines [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61841) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writer thread running {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG oslo_db.sqlalchemy.engines [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61840) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writer thread running {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writer thread running {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writer thread running {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG oslo_db.sqlalchemy.engines [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61840) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG nova.context [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),93e1f09b-7316-4d89-8ce4-b495a7808f8e(cell1) {{(pid=61839) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:36:22 user devstack@n-api.service[61839]: INFO dbcounter [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Registered counter for database nova_cell0 Apr 14 10:36:22 user devstack@n-api.service[61839]: INFO dbcounter [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Registered counter for database nova_cell1 Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG oslo_db.sqlalchemy.engines [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61839) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writer thread running {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG oslo_db.sqlalchemy.engines [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61839) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 10:36:22 user devstack@n-api.service[61841]: INFO dbcounter [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] Registered counter for database nova_cell0 Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writer thread running {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG oslo_db.sqlalchemy.engines [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61841) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 10:36:22 user devstack@n-api.service[61840]: INFO dbcounter [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] Registered counter for database nova_cell0 Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writer thread running {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG oslo_db.sqlalchemy.engines [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61840) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 10:36:22 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writer thread running {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writer thread running {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 10:36:22 user devstack@n-api.service[61839]: INFO dbcounter [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Registered counter for database nova_cell0 Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG oslo_db.sqlalchemy.engines [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61839) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 10:36:22 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writer thread running {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 10:36:22 user devstack@n-api.service[61841]: WARNING keystonemiddleware.auth_token [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 10:36:22 user devstack@n-api.service[61841]: WARNING keystonemiddleware.auth_token [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 10:36:22 user devstack@n-api.service[61840]: WARNING keystonemiddleware.auth_token [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 10:36:22 user devstack@n-api.service[61840]: WARNING keystonemiddleware.auth_token [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 10:36:22 user devstack@n-api.service[61841]: WARNING keystonemiddleware.auth_token [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 10:36:22 user devstack@n-api.service[61841]: WARNING keystonemiddleware.auth_token [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 10:36:22 user devstack@n-api.service[61841]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5579c7724990 pid: 61841 (default app) Apr 14 10:36:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:36:22 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001444 Apr 14 10:36:22 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Fri Apr 14 10:36:22 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:36:22 user devstack@n-api.service[61840]: WARNING keystonemiddleware.auth_token [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 10:36:22 user devstack@n-api.service[61840]: WARNING keystonemiddleware.auth_token [None req-546e6c87-ed4e-46d4-9b0a-30b5d25c2662 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 10:36:22 user devstack@n-api.service[61840]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5579c7724990 pid: 61840 (default app) Apr 14 10:36:22 user devstack@n-api.service[61839]: WARNING keystonemiddleware.auth_token [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 10:36:22 user devstack@n-api.service[61839]: WARNING keystonemiddleware.auth_token [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 10:36:23 user devstack@n-api.service[61839]: WARNING keystonemiddleware.auth_token [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 10:36:23 user devstack@n-api.service[61839]: WARNING keystonemiddleware.auth_token [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 10:36:23 user devstack@n-api.service[61839]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5579c7724990 pid: 61839 (default app) Apr 14 10:38:29 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:38:29 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-c9fcfa2a-7ec4-4b2b-8cee-f8d95fdd7b90 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001520 Apr 14 10:38:29 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 10:38:29 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:38:29 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:38:29 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:38:29 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:38:29 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:38:29 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d41de8d8-3256-4410-bf7d-6fbd8e44675a admin admin] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:38:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d41de8d8-3256-4410-bf7d-6fbd8e44675a admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.451860 Apr 14 10:38:29 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 10:38:29 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:38:31 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:38:31 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002205 Apr 14 10:38:31 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 10:38:31 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:38:31 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:38:31 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:38:31 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:38:31 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:38:31 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-c1536211-f913-4dd9-8359-66f1ea7254ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:31 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-c1536211-f913-4dd9-8359-66f1ea7254ad admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.305749 Apr 14 10:38:31 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 10:38:31 2023] POST /compute/v2.1/flavors => generated 405 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:38:31 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-5e5eec70-8b06-4056-bd0d-15ee07fbf262 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-5e5eec70-8b06-4056-bd0d-15ee07fbf262 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058909 Apr 14 10:38:32 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 10:38:31 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:38:33 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:38:33 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002227 Apr 14 10:38:33 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 10:38:33 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:38:34 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-134273fb-15a1-4eaa-ae87-c58399cd5849 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "name": "ds512M", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:34 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-134273fb-15a1-4eaa-ae87-c58399cd5849 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.085909 Apr 14 10:38:34 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 10:38:33 2023] POST /compute/v2.1/flavors => generated 402 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:38:34 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-0abe7608-124f-4258-9234-bf5d2e43ea05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-0abe7608-124f-4258-9234-bf5d2e43ea05 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058373 Apr 14 10:38:34 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 10:38:34 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:38:36 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:38:36 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001302 Apr 14 10:38:36 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 10:38:36 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:38:36 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-5517b58c-0b3c-4395-a0c4-924376fc0733 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "ram": 1024, "vcpus": 1, "id": "d2"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:36 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-5517b58c-0b3c-4395-a0c4-924376fc0733 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.084525 Apr 14 10:38:36 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 10:38:36 2023] POST /compute/v2.1/flavors => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:38:36 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-2a7aaacf-dd80-43a5-962b-d05de8402532 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:36 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-2a7aaacf-dd80-43a5-962b-d05de8402532 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035841 Apr 14 10:38:36 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 10:38:36 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:38:38 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:38:38 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001428 Apr 14 10:38:38 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 10:38:38 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:38:38 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-0a259512-9356-42e0-9824-5a29b224a7b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:38 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-0a259512-9356-42e0-9824-5a29b224a7b4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.109265 Apr 14 10:38:38 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 10:38:38 2023] POST /compute/v2.1/flavors => generated 402 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:38:38 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-4394c0cf-0963-4fcd-b238-6867558ec8c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:38 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-4394c0cf-0963-4fcd-b238-6867558ec8c3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024289 Apr 14 10:38:38 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 10:38:38 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:38:40 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:38:40 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002140 Apr 14 10:38:40 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 10:38:40 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:38:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-182a7806-5236-4489-803f-1bcdd47f9a07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-182a7806-5236-4489-803f-1bcdd47f9a07 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082067 Apr 14 10:38:40 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 10:38:40 2023] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:38:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-89108bc6-bdb7-411d-85b7-ff209b38a2fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-89108bc6-bdb7-411d-85b7-ff209b38a2fa admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025935 Apr 14 10:38:40 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 10:38:40 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:38:42 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:38:42 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-263bc320-fa36-465b-87c6-a700a02ad1b4 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002826 Apr 14 10:38:42 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 10:38:42 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:38:42 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-ba3f1203-7307-49a3-a277-f41344e49064 admin admin] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:38:42 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-ba3f1203-7307-49a3-a277-f41344e49064 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.068069 Apr 14 10:38:42 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 10:38:42 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 10:38:44 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-89108bc6-bdb7-411d-85b7-ff209b38a2fa admin admin] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:38:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-89108bc6-bdb7-411d-85b7-ff209b38a2fa admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003047 Apr 14 10:38:44 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 10:38:44 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:38:44 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=3 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:38:44 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=3 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:38:44 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=3 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:38:44 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=3 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:38:45 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-cfe1e3c6-27e1-4f9c-95cf-76d8440c7b18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1, "ram": 512, "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:45 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-cfe1e3c6-27e1-4f9c-95cf-76d8440c7b18 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.363545 Apr 14 10:38:45 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 10:38:44 2023] POST /compute/v2.1/flavors => generated 400 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:38:45 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-1d3081d6-c002-4e3d-a048-8e621bd6c3b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:45 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-1d3081d6-c002-4e3d-a048-8e621bd6c3b6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038141 Apr 14 10:38:45 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 10:38:45 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:38:47 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-89108bc6-bdb7-411d-85b7-ff209b38a2fa admin admin] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:38:47 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-89108bc6-bdb7-411d-85b7-ff209b38a2fa admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002152 Apr 14 10:38:47 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 10:38:47 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:38:47 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-6c117b97-0f2f-493f-92e6-563d2202970d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1, "ram": 2048, "disk": 20}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:47 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-6c117b97-0f2f-493f-92e6-563d2202970d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.070973 Apr 14 10:38:47 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 10:38:47 2023] POST /compute/v2.1/flavors => generated 403 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:38:47 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-4361918c-be3c-417a-84e9-cd79294b44c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:47 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-4361918c-be3c-417a-84e9-cd79294b44c2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027917 Apr 14 10:38:47 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 10:38:47 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:38:49 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-89108bc6-bdb7-411d-85b7-ff209b38a2fa admin admin] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:38:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-89108bc6-bdb7-411d-85b7-ff209b38a2fa admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002618 Apr 14 10:38:49 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 10:38:49 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:38:49 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-2f6a357d-a46d-4280-b89d-eccea654d98d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "disk": 40, "name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:49 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-2f6a357d-a46d-4280-b89d-eccea654d98d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071707 Apr 14 10:38:49 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 10:38:49 2023] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:38:49 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-8a88d8d6-eedd-4c85-9a36-7a69ac558ec1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:49 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-8a88d8d6-eedd-4c85-9a36-7a69ac558ec1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025804 Apr 14 10:38:49 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 10:38:49 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:38:51 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-89108bc6-bdb7-411d-85b7-ff209b38a2fa admin admin] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:38:51 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-89108bc6-bdb7-411d-85b7-ff209b38a2fa admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001546 Apr 14 10:38:51 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 10:38:51 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:38:51 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-fc549713-a961-4e12-9d3f-2153ddda62ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "id": "4", "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:51 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-fc549713-a961-4e12-9d3f-2153ddda62ac admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.062476 Apr 14 10:38:51 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 10:38:51 2023] POST /compute/v2.1/flavors => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:38:51 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a233f5b6-9992-47c4-8256-66208a68a0e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:51 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a233f5b6-9992-47c4-8256-66208a68a0e0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026712 Apr 14 10:38:51 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 10:38:51 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:38:53 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-89108bc6-bdb7-411d-85b7-ff209b38a2fa admin admin] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:38:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-89108bc6-bdb7-411d-85b7-ff209b38a2fa admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001544 Apr 14 10:38:53 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 10:38:53 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:38:53 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f97ca206-02aa-49a7-88f5-fc68b4a435a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "disk": 160, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:53 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-f97ca206-02aa-49a7-88f5-fc68b4a435a4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074012 Apr 14 10:38:53 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 10:38:53 2023] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:38:53 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a4165ec4-3598-48d3-8c6b-5f80f389dfd6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:38:53 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a4165ec4-3598-48d3-8c6b-5f80f389dfd6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027525 Apr 14 10:38:53 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 10:38:53 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:39:24 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-89108bc6-bdb7-411d-85b7-ff209b38a2fa admin admin] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:39:24 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-89108bc6-bdb7-411d-85b7-ff209b38a2fa admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001558 Apr 14 10:39:24 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 10:39:24 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:39:24 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:39:24 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-75d778f4-4c1f-4d52-bc14-837153b87165 admin admin] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:39:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-75d778f4-4c1f-4d52-bc14-837153b87165 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:39:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-75d778f4-4c1f-4d52-bc14-837153b87165 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:39:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-75d778f4-4c1f-4d52-bc14-837153b87165 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:39:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-75d778f4-4c1f-4d52-bc14-837153b87165 admin admin] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:39:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-75d778f4-4c1f-4d52-bc14-837153b87165 admin admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:39:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-75d778f4-4c1f-4d52-bc14-837153b87165 admin admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:39:24 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-75d778f4-4c1f-4d52-bc14-837153b87165 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.093753 Apr 14 10:39:24 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Fri Apr 14 10:39:24 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:39:56 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a4165ec4-3598-48d3-8c6b-5f80f389dfd6 admin admin] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:39:56 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a4165ec4-3598-48d3-8c6b-5f80f389dfd6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001411 Apr 14 10:39:56 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 10:39:56 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:39:56 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:39:56 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-08d31497-5d74-4de6-8faa-f9b72cd26c4b admin admin] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:39:57 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-08d31497-5d74-4de6-8faa-f9b72cd26c4b admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.071228 Apr 14 10:39:57 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Fri Apr 14 10:39:56 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:40:01 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-75d778f4-4c1f-4d52-bc14-837153b87165 admin admin] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:40:01 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-75d778f4-4c1f-4d52-bc14-837153b87165 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001423 Apr 14 10:40:01 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 10:40:01 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:40:01 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:40:01 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-4ad72b07-8e75-4b42-abb3-91e53ccb2890 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "42", "disk": 1, "name": "m1.nano", "swap": 0, "ram": 128, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:40:01 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-4ad72b07-8e75-4b42-abb3-91e53ccb2890 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.064011 Apr 14 10:40:01 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 10:40:01 2023] POST /compute/v2.1/flavors => generated 403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:40:01 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-468c8e71-76f5-4434-b112-2e2f9100f204 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:40:01 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-468c8e71-76f5-4434-b112-2e2f9100f204 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026047 Apr 14 10:40:01 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 10:40:01 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:40:05 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-75d778f4-4c1f-4d52-bc14-837153b87165 admin admin] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:40:05 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-75d778f4-4c1f-4d52-bc14-837153b87165 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001512 Apr 14 10:40:05 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 10:40:05 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:40:05 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-bc8287c6-5aa3-44f6-8704-bb70ac80d579 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "84", "swap": 0, "name": "m1.micro", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:40:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-bc8287c6-5aa3-44f6-8704-bb70ac80d579 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.062090 Apr 14 10:40:05 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 10:40:05 2023] POST /compute/v2.1/flavors => generated 404 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:40:05 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-f03c63ca-4441-4207-8d54-5e04435b4015 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:40:05 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-f03c63ca-4441-4207-8d54-5e04435b4015 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026299 Apr 14 10:40:05 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 10:40:05 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 10:42:21 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:42:21 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:42:21 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:42:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-08046c15-9b49-4121-8ad2-70c0c23b6159 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] Calling method '.version_select at 0x7fcd1e09f400>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:22 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-08046c15-9b49-4121-8ad2-70c0c23b6159 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/96ebf316-f411-4f55-bed8-b55114d7da22" status: 200 len: 351 microversion: 2.1 time: 0.412451 Apr 14 10:42:22 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 15/46] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 10:42:21 2023] GET /compute/v2.1/os-volumes/96ebf316-f411-4f55-bed8-b55114d7da22 => generated 351 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:42:25 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:42:25 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e7840677-3ea3-4a1f-acd6-b77435cb1677 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] Calling method '.version_select at 0x7fcd1e08bb50>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:25 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-e7840677-3ea3-4a1f-acd6-b77435cb1677 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8500c817-c497-43ff-ab42-95536a6ec718" status: 200 len: 351 microversion: 2.1 time: 0.390936 Apr 14 10:42:25 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 10:42:25 2023] GET /compute/v2.1/os-volumes/8500c817-c497-43ff-ab42-95536a6ec718 => generated 351 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:42:28 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:42:28 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-f791c3b7-7a2c-40fe-8f6d-6bca7df81b68 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] Calling method '.version_select at 0x7fcd1e07f400>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:28 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-f791c3b7-7a2c-40fe-8f6d-6bca7df81b68 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/418d6e24-9860-4ed1-ae78-a8feac7ac725" status: 200 len: 350 microversion: 2.1 time: 0.255160 Apr 14 10:42:28 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 10:42:28 2023] GET /compute/v2.1/os-volumes/418d6e24-9860-4ed1-ae78-a8feac7ac725 => generated 350 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:42:28 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-ab17a548-e50a-4fb4-b49d-78a33cdfc407 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] Calling method '.version_select at 0x7fcd1e09ed40>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:28 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-ab17a548-e50a-4fb4-b49d-78a33cdfc407 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.112061 Apr 14 10:42:28 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 10:42:28 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:42:28 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9242ed67-d6f8-49b4-b7bf-12f02c5f2a68 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] Calling method '.version_select at 0x7fcd1e293f40>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:28 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-9242ed67-d6f8-49b4-b7bf-12f02c5f2a68 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.098348 Apr 14 10:42:28 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1226 bytes} [Fri Apr 14 10:42:28 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:42:28 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-9d311903-8965-4640-ac8d-a7e81badfd6f tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] Calling method '.version_select at 0x7fcd1df270a0>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:28 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-9d311903-8965-4640-ac8d-a7e81badfd6f tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.164842 Apr 14 10:42:28 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 10:42:28 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:42:28 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-bdbd5abe-d3ea-4dd8-ad79-5b11b2c85654 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] Calling method '.version_select at 0x7fcd1e09eef0>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:28 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-bdbd5abe-d3ea-4dd8-ad79-5b11b2c85654 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.103267 Apr 14 10:42:28 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1244 bytes} [Fri Apr 14 10:42:28 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:42:28 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-0d5bff85-031e-4f82-83e4-a3fe4bd9037f tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] Calling method '.version_select at 0x7fcd1df27b50>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:28 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-0d5bff85-031e-4f82-83e4-a3fe4bd9037f tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084388 Apr 14 10:42:28 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1247 bytes} [Fri Apr 14 10:42:28 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:42:29 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ba8296f2-b731-414e-8152-1654420e13a9 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] Calling method '.version_select at 0x7fcd1df38430>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-ba8296f2-b731-414e-8152-1654420e13a9 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091610 Apr 14 10:42:29 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 10:42:29 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:42:29 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-bbf80adc-cfdf-4829-8bfb-cf0b3502011d tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] Calling method '.version_select at 0x7fcd1df2d900>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:29 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-bbf80adc-cfdf-4829-8bfb-cf0b3502011d tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.098722 Apr 14 10:42:29 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1265 bytes} [Fri Apr 14 10:42:29 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:42:29 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-fbc6f750-db53-4ffe-9167-c2edb36d7392 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] Calling method '.version_select at 0x7fcd1df40dc0>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:29 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-fbc6f750-db53-4ffe-9167-c2edb36d7392 tempest-VolumesTestJSON-363274993 tempest-VolumesTestJSON-363274993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.081251 Apr 14 10:42:29 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 10:42:29 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:42:37 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1726126636", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "networks": [{"uuid": "8034a3f8-0149-4d7b-b457-350a881baafe"}]}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:42:37 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] validate_networks() for [('8034a3f8-0149-4d7b-b457-350a881baafe', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:42:38 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1197292957", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:42:38 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:42:38 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:42:38 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:42:38 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:42:38 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:42:39 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:39 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:39 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:39 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:39 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:39 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:39 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Getting quotas for project 30856983340a435d8e92f138fdecaa35. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:42:39 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] validate_networks() for [('22eb5f87-be4d-447d-bafe-25e0284ea3ca', None, None, None, None, None)] {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:42:39 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Getting quotas for user 0a9842a4c91c4d45b52da0b404fc27c2 and project 30856983340a435d8e92f138fdecaa35. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:42:39 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:42:39 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:42:39 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.092139 Apr 14 10:42:39 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 19/57] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:42:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 2095 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:42:39 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-fcf3f602-7b1c-4a8d-b821-56771d29d64e tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Action: 'create', calling method: .version_select at 0x7fcd1df27c70>, body: {"keypair": {"name": "tempest-keypair-1544270235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw=="}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:42:39 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-b3ac3661-c2cc-4e9a-b1af-aa390b24f075 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:39 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-b3ac3661-c2cc-4e9a-b1af-aa390b24f075 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:42:39 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-fcf3f602-7b1c-4a8d-b821-56771d29d64e tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting quotas for project 3ea2cb4dfa5b4a52b658efd8f5aefb36. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:42:39 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-fcf3f602-7b1c-4a8d-b821-56771d29d64e tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting quotas for user 5873a358bf544691b12cd2979f5e36dc and project 3ea2cb4dfa5b4a52b658efd8f5aefb36. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:42:39 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-fcf3f602-7b1c-4a8d-b821-56771d29d64e tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.251356 Apr 14 10:42:39 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 21/58] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 10:42:39 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:42:39 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-b3ac3661-c2cc-4e9a-b1af-aa390b24f075 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9842a4c91c4d45b52da0b404fc27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30856983340a435d8e92f138fdecaa35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:42:39 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-b3ac3661-c2cc-4e9a-b1af-aa390b24f075 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a" status: 200 len: 1209 microversion: 2.1 time: 0.387163 Apr 14 10:42:39 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 20/59] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:42:39 2023] GET /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a => generated 1209 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:42:40 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:42:40 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:42:40 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:42:40 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:42:40 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:42:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:40 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Getting quotas for project bf93e5dac50342d0b65ef09711401e99. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:42:40 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Getting quotas for user e359578dcbb24755a216415053d415ef and project bf93e5dac50342d0b65ef09711401e99. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:42:40 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:42:40 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:42:40 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.086947 Apr 14 10:42:40 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 19/60] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:42:38 2023] POST /compute/v2.1/servers => generated 381 bytes in 2100 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:42:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-30266257-d4a4-42c2-b2de-157cd874664a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:40 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-30266257-d4a4-42c2-b2de-157cd874664a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:42:41 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-30266257-d4a4-42c2-b2de-157cd874664a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:42:41 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-30266257-d4a4-42c2-b2de-157cd874664a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade" status: 200 len: 1216 microversion: 2.1 time: 0.299584 Apr 14 10:42:41 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 22/61] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:42:40 2023] GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade => generated 1216 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:42:41 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-97128358", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:42:41 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] validate_networks() for [('22eb5f87-be4d-447d-bafe-25e0284ea3ca', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:42:42 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:42:42 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:42:42 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:42:42 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:42:42 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:42:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:42 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Getting quotas for project bf93e5dac50342d0b65ef09711401e99. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:42:42 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Getting quotas for user e359578dcbb24755a216415053d415ef and project bf93e5dac50342d0b65ef09711401e99. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:42:42 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:42:42 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:42:42 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.141598 Apr 14 10:42:42 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 21/62] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:42:41 2023] POST /compute/v2.1/servers => generated 381 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 14 10:42:42 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-5b3fcd29-8b97-4682-8cfb-78e36ebc733e tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:42 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-5b3fcd29-8b97-4682-8cfb-78e36ebc733e tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:42:42 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-5b3fcd29-8b97-4682-8cfb-78e36ebc733e tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:42:42 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-5b3fcd29-8b97-4682-8cfb-78e36ebc733e tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a" status: 200 len: 1214 microversion: 2.1 time: 0.262162 Apr 14 10:42:42 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 20/63] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:42:42 2023] GET /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a => generated 1214 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:42:47 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-375061147", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "18a91434-637b-4c19-a97b-736b32c1ea5a"}], "security_groups": [{"name": "tempest-securitygroup--494137881"}], "key_name": "tempest-keypair-1544270235", "user_data": "}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:42:48 user devstack@n-api.service[61841]: DEBUG nova.network.neutron [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] validate_networks() for [('18a91434-637b-4c19-a97b-736b32c1ea5a', None, None, None, None, None)] {{(pid=61841) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:42:48 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-b924fbeb-9138-48c5-a5b8-cff38de1abee tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Action: 'create', calling method: .version_select at 0x7fcd1dfedd80>, body: {"keypair": {"name": "tempest-keypair-882808316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJw5z6VaHRNlxDN06wTJu5Wi0bke1xDu+QHMTsTYS+v80iCfFQaOubP6JBaY/P1b1NeL45VzvxaEoBY4znewTkoI5fdIZ/AucgMjWw1BB8Bl59D4DxJIt+KUZTUDjHw3Lg=="}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:42:48 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-b924fbeb-9138-48c5-a5b8-cff38de1abee tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Getting quotas for project 482809b9148e408b84b156802a21a225. Resources: {'key_pairs'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:42:48 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-b924fbeb-9138-48c5-a5b8-cff38de1abee tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Getting quotas for user 7212c3fe50ef465c99a0eefec4cbd753 and project 482809b9148e408b84b156802a21a225. Resources: {'key_pairs'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:42:48 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-b924fbeb-9138-48c5-a5b8-cff38de1abee tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.276278 Apr 14 10:42:48 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 22/64] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 10:42:47 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:42:48 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-304899f8-bc73-4897-9b07-2ce7dda54a68 req-f07312cc-0228-4bf2-b191-a93f5d6dbe43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:42:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-304899f8-bc73-4897-9b07-2ce7dda54a68 req-f07312cc-0228-4bf2-b191-a93f5d6dbe43 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-304899f8-bc73-4897-9b07-2ce7dda54a68 req-f07312cc-0228-4bf2-b191-a93f5d6dbe43 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-304899f8-bc73-4897-9b07-2ce7dda54a68 req-f07312cc-0228-4bf2-b191-a93f5d6dbe43 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:48 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-304899f8-bc73-4897-9b07-2ce7dda54a68 req-f07312cc-0228-4bf2-b191-a93f5d6dbe43 service nova] Creating event network-changed:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:42:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-304899f8-bc73-4897-9b07-2ce7dda54a68 req-f07312cc-0228-4bf2-b191-a93f5d6dbe43 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61839) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 10:42:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-304899f8-bc73-4897-9b07-2ce7dda54a68 req-f07312cc-0228-4bf2-b191-a93f5d6dbe43 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61839) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 10:42:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-65da4f45-3c06-4880-bdf1-70135805e972 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-65da4f45-3c06-4880-bdf1-70135805e972 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-65da4f45-3c06-4880-bdf1-70135805e972 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-65da4f45-3c06-4880-bdf1-70135805e972 None None] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-65da4f45-3c06-4880-bdf1-70135805e972 None None] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-65da4f45-3c06-4880-bdf1-70135805e972 None None] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:48 user devstack@n-api.service[61839]: INFO nova.compute.rpcapi [None req-65da4f45-3c06-4880-bdf1-70135805e972 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 10:42:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-65da4f45-3c06-4880-bdf1-70135805e972 None None] Releasing lock "compute-rpcapi-router" {{(pid=61839) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 10:42:48 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-65da4f45-3c06-4880-bdf1-70135805e972 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162505 Apr 14 10:42:48 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 21/65] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:42:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:42:49 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-b2d7d32d-8c09-44ce-957a-5c7922cf9e0f req-6a37201b-e84e-4c73-b76e-71859b58dc42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c90a9b99-0985-403b-b4d8-eaa8c2eed88a", "tag": "5bd8d359-958a-4b76-ac87-156c2a2adf35"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:42:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b2d7d32d-8c09-44ce-957a-5c7922cf9e0f req-6a37201b-e84e-4c73-b76e-71859b58dc42 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b2d7d32d-8c09-44ce-957a-5c7922cf9e0f req-6a37201b-e84e-4c73-b76e-71859b58dc42 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b2d7d32d-8c09-44ce-957a-5c7922cf9e0f req-6a37201b-e84e-4c73-b76e-71859b58dc42 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-b2d7d32d-8c09-44ce-957a-5c7922cf9e0f req-6a37201b-e84e-4c73-b76e-71859b58dc42 service nova] Creating event network-changed:5bd8d359-958a-4b76-ac87-156c2a2adf35 for instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a on user Apr 14 10:42:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b2d7d32d-8c09-44ce-957a-5c7922cf9e0f req-6a37201b-e84e-4c73-b76e-71859b58dc42 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61840) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 10:42:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b2d7d32d-8c09-44ce-957a-5c7922cf9e0f req-6a37201b-e84e-4c73-b76e-71859b58dc42 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61840) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 10:42:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-32cbedcb-8ecd-43c9-90ab-0cd55f3cb3b6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-32cbedcb-8ecd-43c9-90ab-0cd55f3cb3b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-32cbedcb-8ecd-43c9-90ab-0cd55f3cb3b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-32cbedcb-8ecd-43c9-90ab-0cd55f3cb3b6 None None] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-32cbedcb-8ecd-43c9-90ab-0cd55f3cb3b6 None None] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-32cbedcb-8ecd-43c9-90ab-0cd55f3cb3b6 None None] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:49 user devstack@n-api.service[61840]: INFO nova.compute.rpcapi [None req-32cbedcb-8ecd-43c9-90ab-0cd55f3cb3b6 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 10:42:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-32cbedcb-8ecd-43c9-90ab-0cd55f3cb3b6 None None] Releasing lock "compute-rpcapi-router" {{(pid=61840) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 10:42:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-32cbedcb-8ecd-43c9-90ab-0cd55f3cb3b6 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169263 Apr 14 10:42:49 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 23/66] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:42:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:42:50 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:42:50 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:42:50 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:42:50 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:42:50 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:42:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:50 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting quotas for project 3ea2cb4dfa5b4a52b658efd8f5aefb36. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:42:50 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting quotas for user 5873a358bf544691b12cd2979f5e36dc and project 3ea2cb4dfa5b4a52b658efd8f5aefb36. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:42:50 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Going to run 1 instances... {{(pid=61841) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:42:50 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61841) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:42:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.633004 Apr 14 10:42:50 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 23/67] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:42:47 2023] POST /compute/v2.1/servers => generated 406 bytes in 2635 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:42:50 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-3892557a-22d2-45dc-a9f8-c85e4fd96493 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:50 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-3892557a-22d2-45dc-a9f8-c85e4fd96493 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:42:50 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-3892557a-22d2-45dc-a9f8-c85e4fd96493 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:42:50 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-3892557a-22d2-45dc-a9f8-c85e4fd96493 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1232 microversion: 2.1 time: 0.077146 Apr 14 10:42:50 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 22/68] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:42:50 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1232 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:42:50 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-1699522a-9329-4f4b-b6ba-c980c6a42bb1 req-aa719403-1320-4aad-b80f-b403f8b09142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97820f17-22d1-4ec3-9721-1edadccc794a", "tag": "dea3830d-9f49-4d5e-953b-eec2ee969b02"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:42:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-1699522a-9329-4f4b-b6ba-c980c6a42bb1 req-aa719403-1320-4aad-b80f-b403f8b09142 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-1699522a-9329-4f4b-b6ba-c980c6a42bb1 req-aa719403-1320-4aad-b80f-b403f8b09142 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-1699522a-9329-4f4b-b6ba-c980c6a42bb1 req-aa719403-1320-4aad-b80f-b403f8b09142 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-1699522a-9329-4f4b-b6ba-c980c6a42bb1 req-aa719403-1320-4aad-b80f-b403f8b09142 service nova] Creating event network-changed:dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance 97820f17-22d1-4ec3-9721-1edadccc794a on user Apr 14 10:42:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-1699522a-9329-4f4b-b6ba-c980c6a42bb1 req-aa719403-1320-4aad-b80f-b403f8b09142 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064069 Apr 14 10:42:50 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 24/69] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:42:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:42:53 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-67cb2089-75ce-4be7-b47b-c0adb0dc357c req-9dead13e-da4f-43c1-85b2-755bce71465d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:42:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-67cb2089-75ce-4be7-b47b-c0adb0dc357c req-9dead13e-da4f-43c1-85b2-755bce71465d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-67cb2089-75ce-4be7-b47b-c0adb0dc357c req-9dead13e-da4f-43c1-85b2-755bce71465d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-67cb2089-75ce-4be7-b47b-c0adb0dc357c req-9dead13e-da4f-43c1-85b2-755bce71465d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:53 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-67cb2089-75ce-4be7-b47b-c0adb0dc357c req-9dead13e-da4f-43c1-85b2-755bce71465d service nova] Creating event network-changed:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:42:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-67cb2089-75ce-4be7-b47b-c0adb0dc357c req-9dead13e-da4f-43c1-85b2-755bce71465d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61841) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 10:42:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-67cb2089-75ce-4be7-b47b-c0adb0dc357c req-9dead13e-da4f-43c1-85b2-755bce71465d service nova] Acquired lock "compute-rpcapi-router" {{(pid=61841) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 10:42:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8d707a1-439d-40f1-9d68-a81904e530d4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8d707a1-439d-40f1-9d68-a81904e530d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8d707a1-439d-40f1-9d68-a81904e530d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8d707a1-439d-40f1-9d68-a81904e530d4 None None] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8d707a1-439d-40f1-9d68-a81904e530d4 None None] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8d707a1-439d-40f1-9d68-a81904e530d4 None None] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:53 user devstack@n-api.service[61841]: INFO nova.compute.rpcapi [None req-a8d707a1-439d-40f1-9d68-a81904e530d4 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 10:42:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8d707a1-439d-40f1-9d68-a81904e530d4 None None] Releasing lock "compute-rpcapi-router" {{(pid=61841) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 10:42:53 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a8d707a1-439d-40f1-9d68-a81904e530d4 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096553 Apr 14 10:42:53 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 24/70] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:42:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:42:54 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-715949836", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "networks": [{"uuid": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c"}], "security_groups": [{"name": "tempest-securitygroup--1315217283"}], "key_name": "tempest-keypair-882808316", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:42:54 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] validate_networks() for [('9040ebc7-4d6b-4fd2-8543-f22ca3fb249c', None, None, None, None, None)] {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:42:56 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:42:56 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:42:56 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:42:56 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:42:56 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:42:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:56 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Getting quotas for project 482809b9148e408b84b156802a21a225. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:42:56 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Getting quotas for user 7212c3fe50ef465c99a0eefec4cbd753 and project 482809b9148e408b84b156802a21a225. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:42:56 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:42:56 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:42:56 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.960459 Apr 14 10:42:56 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 23/71] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:42:54 2023] POST /compute/v2.1/servers => generated 404 bytes in 1962 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:42:56 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-fc770026-0892-4127-bded-284fb4fa9ff4 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:42:56 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-fc770026-0892-4127-bded-284fb4fa9ff4 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:42:56 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-8aa5f623-e5d5-4ebe-bb9d-921a52240c46 req-c91351a1-d901-4c2c-965f-773cbc27914f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97820f17-22d1-4ec3-9721-1edadccc794a", "name": "network-vif-plugged", "status": "completed", "tag": "dea3830d-9f49-4d5e-953b-eec2ee969b02"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:42:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-8aa5f623-e5d5-4ebe-bb9d-921a52240c46 req-c91351a1-d901-4c2c-965f-773cbc27914f service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-8aa5f623-e5d5-4ebe-bb9d-921a52240c46 req-c91351a1-d901-4c2c-965f-773cbc27914f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-8aa5f623-e5d5-4ebe-bb9d-921a52240c46 req-c91351a1-d901-4c2c-965f-773cbc27914f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:56 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-8aa5f623-e5d5-4ebe-bb9d-921a52240c46 req-c91351a1-d901-4c2c-965f-773cbc27914f service nova] Creating event network-vif-plugged:dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance 97820f17-22d1-4ec3-9721-1edadccc794a on user Apr 14 10:42:56 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-fc770026-0892-4127-bded-284fb4fa9ff4 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7212c3fe50ef465c99a0eefec4cbd753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482809b9148e408b84b156802a21a225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:42:56 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-8aa5f623-e5d5-4ebe-bb9d-921a52240c46 req-c91351a1-d901-4c2c-965f-773cbc27914f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065885 Apr 14 10:42:56 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 25/72] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:42:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:42:56 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-fc770026-0892-4127-bded-284fb4fa9ff4 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce" status: 200 len: 1238 microversion: 2.1 time: 0.369809 Apr 14 10:42:56 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 25/73] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:42:56 2023] GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce => generated 1238 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:42:58 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-9b29b29c-e9ca-4e10-a308-69e3be01fa7d req-2bba7b2e-693e-45b1-b7b9-fa7fc45da120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97820f17-22d1-4ec3-9721-1edadccc794a", "name": "network-vif-plugged", "status": "completed", "tag": "dea3830d-9f49-4d5e-953b-eec2ee969b02"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:42:58 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9b29b29c-e9ca-4e10-a308-69e3be01fa7d req-2bba7b2e-693e-45b1-b7b9-fa7fc45da120 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:58 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9b29b29c-e9ca-4e10-a308-69e3be01fa7d req-2bba7b2e-693e-45b1-b7b9-fa7fc45da120 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:58 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9b29b29c-e9ca-4e10-a308-69e3be01fa7d req-2bba7b2e-693e-45b1-b7b9-fa7fc45da120 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:42:58 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-9b29b29c-e9ca-4e10-a308-69e3be01fa7d req-2bba7b2e-693e-45b1-b7b9-fa7fc45da120 service nova] Creating event network-vif-plugged:dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance 97820f17-22d1-4ec3-9721-1edadccc794a on user Apr 14 10:42:58 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-9b29b29c-e9ca-4e10-a308-69e3be01fa7d req-2bba7b2e-693e-45b1-b7b9-fa7fc45da120 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081750 Apr 14 10:42:58 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 24/74] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:42:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:42:59 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-6d793bcd-eb3f-4241-8c87-03bf2d5d3eb5 req-d36224ad-4f04-42c2-805d-315054373e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-plugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:42:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6d793bcd-eb3f-4241-8c87-03bf2d5d3eb5 req-d36224ad-4f04-42c2-805d-315054373e92 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:42:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6d793bcd-eb3f-4241-8c87-03bf2d5d3eb5 req-d36224ad-4f04-42c2-805d-315054373e92 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:42:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6d793bcd-eb3f-4241-8c87-03bf2d5d3eb5 req-d36224ad-4f04-42c2-805d-315054373e92 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:00 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-6d793bcd-eb3f-4241-8c87-03bf2d5d3eb5 req-d36224ad-4f04-42c2-805d-315054373e92 service nova] Creating event network-vif-plugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:43:00 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-6d793bcd-eb3f-4241-8c87-03bf2d5d3eb5 req-d36224ad-4f04-42c2-805d-315054373e92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194372 Apr 14 10:43:00 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 26/75] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:42:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:01 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-ac456397-f77c-49ae-aaea-f3cedf633e4c req-325407b6-3e29-4ea6-b178-5d11dd4d3c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-plugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:01 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:01 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=10 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:01 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=7 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:01 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ac456397-f77c-49ae-aaea-f3cedf633e4c req-325407b6-3e29-4ea6-b178-5d11dd4d3c8a service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:01 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ac456397-f77c-49ae-aaea-f3cedf633e4c req-325407b6-3e29-4ea6-b178-5d11dd4d3c8a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:01 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ac456397-f77c-49ae-aaea-f3cedf633e4c req-325407b6-3e29-4ea6-b178-5d11dd4d3c8a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:01 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-ac456397-f77c-49ae-aaea-f3cedf633e4c req-325407b6-3e29-4ea6-b178-5d11dd4d3c8a service nova] Creating event network-vif-plugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:43:01 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-ac456397-f77c-49ae-aaea-f3cedf633e4c req-325407b6-3e29-4ea6-b178-5d11dd4d3c8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234325 Apr 14 10:43:01 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 26/76] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:02 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-6ba1c4da-f804-4366-952c-9f9074a3aa60 req-495263a6-d7ed-4c34-b409-2abfbeae3d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-plugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-6ba1c4da-f804-4366-952c-9f9074a3aa60 req-495263a6-d7ed-4c34-b409-2abfbeae3d73 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-6ba1c4da-f804-4366-952c-9f9074a3aa60 req-495263a6-d7ed-4c34-b409-2abfbeae3d73 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-6ba1c4da-f804-4366-952c-9f9074a3aa60 req-495263a6-d7ed-4c34-b409-2abfbeae3d73 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:02 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-6ba1c4da-f804-4366-952c-9f9074a3aa60 req-495263a6-d7ed-4c34-b409-2abfbeae3d73 service nova] Creating event network-vif-plugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:43:02 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-6ba1c4da-f804-4366-952c-9f9074a3aa60 req-495263a6-d7ed-4c34-b409-2abfbeae3d73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098091 Apr 14 10:43:02 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 25/77] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:02 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=12 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:02 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-52ea002a-fea9-442d-8b07-7a9f7910cdbc req-ca9dad8a-35a4-479f-9dbf-905530e5bfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-52ea002a-fea9-442d-8b07-7a9f7910cdbc req-ca9dad8a-35a4-479f-9dbf-905530e5bfd4 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-52ea002a-fea9-442d-8b07-7a9f7910cdbc req-ca9dad8a-35a4-479f-9dbf-905530e5bfd4 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-52ea002a-fea9-442d-8b07-7a9f7910cdbc req-ca9dad8a-35a4-479f-9dbf-905530e5bfd4 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:02 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-52ea002a-fea9-442d-8b07-7a9f7910cdbc req-ca9dad8a-35a4-479f-9dbf-905530e5bfd4 service nova] Creating event network-changed:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:43:02 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-52ea002a-fea9-442d-8b07-7a9f7910cdbc req-ca9dad8a-35a4-479f-9dbf-905530e5bfd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155635 Apr 14 10:43:02 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 27/78] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:03 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-dce8b1fa-71c7-4186-9da8-97d775ba82fd req-5068056c-979e-4ad3-954e-bdd13add03eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-plugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-dce8b1fa-71c7-4186-9da8-97d775ba82fd req-5068056c-979e-4ad3-954e-bdd13add03eb service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-dce8b1fa-71c7-4186-9da8-97d775ba82fd req-5068056c-979e-4ad3-954e-bdd13add03eb service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-dce8b1fa-71c7-4186-9da8-97d775ba82fd req-5068056c-979e-4ad3-954e-bdd13add03eb service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:04 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-dce8b1fa-71c7-4186-9da8-97d775ba82fd req-5068056c-979e-4ad3-954e-bdd13add03eb service nova] Creating event network-vif-plugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:43:04 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-dce8b1fa-71c7-4186-9da8-97d775ba82fd req-5068056c-979e-4ad3-954e-bdd13add03eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168958 Apr 14 10:43:04 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 27/79] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:06 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-72ada868-d1b9-4781-b6db-7683f9cbb03f req-07a7d72b-6c66-4e3e-abfa-f309cb5e4c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90a9b99-0985-403b-b4d8-eaa8c2eed88a", "name": "network-vif-plugged", "status": "completed", "tag": "5bd8d359-958a-4b76-ac87-156c2a2adf35"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:06 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-72ada868-d1b9-4781-b6db-7683f9cbb03f req-07a7d72b-6c66-4e3e-abfa-f309cb5e4c8b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:06 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-72ada868-d1b9-4781-b6db-7683f9cbb03f req-07a7d72b-6c66-4e3e-abfa-f309cb5e4c8b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:06 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-72ada868-d1b9-4781-b6db-7683f9cbb03f req-07a7d72b-6c66-4e3e-abfa-f309cb5e4c8b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:06 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-72ada868-d1b9-4781-b6db-7683f9cbb03f req-07a7d72b-6c66-4e3e-abfa-f309cb5e4c8b service nova] Creating event network-vif-plugged:5bd8d359-958a-4b76-ac87-156c2a2adf35 for instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a on user Apr 14 10:43:06 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-72ada868-d1b9-4781-b6db-7683f9cbb03f req-07a7d72b-6c66-4e3e-abfa-f309cb5e4c8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092380 Apr 14 10:43:06 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 26/80] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:07 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:07 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-aa4378c7-e296-41cf-845b-4f7fb028f415 req-9d6e836b-099b-4948-bde4-82ac822c09f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "name": "network-vif-plugged", "status": "completed", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-aa4378c7-e296-41cf-845b-4f7fb028f415 req-9d6e836b-099b-4948-bde4-82ac822c09f2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-aa4378c7-e296-41cf-845b-4f7fb028f415 req-9d6e836b-099b-4948-bde4-82ac822c09f2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-aa4378c7-e296-41cf-845b-4f7fb028f415 req-9d6e836b-099b-4948-bde4-82ac822c09f2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:07 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-aa4378c7-e296-41cf-845b-4f7fb028f415 req-9d6e836b-099b-4948-bde4-82ac822c09f2 service nova] Creating event network-vif-plugged:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:43:07 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-aa4378c7-e296-41cf-845b-4f7fb028f415 req-9d6e836b-099b-4948-bde4-82ac822c09f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121278 Apr 14 10:43:07 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 28/81] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:08 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=20 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:08 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-f20442f2-d9b0-400b-ac2c-e0b15f1c434e req-3aa5003a-eb35-482b-a916-9fea3592ebac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90a9b99-0985-403b-b4d8-eaa8c2eed88a", "name": "network-vif-plugged", "status": "completed", "tag": "5bd8d359-958a-4b76-ac87-156c2a2adf35"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f20442f2-d9b0-400b-ac2c-e0b15f1c434e req-3aa5003a-eb35-482b-a916-9fea3592ebac service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f20442f2-d9b0-400b-ac2c-e0b15f1c434e req-3aa5003a-eb35-482b-a916-9fea3592ebac service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f20442f2-d9b0-400b-ac2c-e0b15f1c434e req-3aa5003a-eb35-482b-a916-9fea3592ebac service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:08 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-f20442f2-d9b0-400b-ac2c-e0b15f1c434e req-3aa5003a-eb35-482b-a916-9fea3592ebac service nova] Creating event network-vif-plugged:5bd8d359-958a-4b76-ac87-156c2a2adf35 for instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a on user Apr 14 10:43:08 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-f20442f2-d9b0-400b-ac2c-e0b15f1c434e req-3aa5003a-eb35-482b-a916-9fea3592ebac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095739 Apr 14 10:43:08 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 28/82] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:09 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:09 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=16 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:09 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-0a3eb9ee-ba96-40d6-acdb-ebe6e5bdd282 req-b8bb7481-4d39-4fe9-9f6f-91f8a5f1caf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "name": "network-vif-plugged", "status": "completed", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:09 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-0a3eb9ee-ba96-40d6-acdb-ebe6e5bdd282 req-b8bb7481-4d39-4fe9-9f6f-91f8a5f1caf9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-0a3eb9ee-ba96-40d6-acdb-ebe6e5bdd282 req-b8bb7481-4d39-4fe9-9f6f-91f8a5f1caf9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-0a3eb9ee-ba96-40d6-acdb-ebe6e5bdd282 req-b8bb7481-4d39-4fe9-9f6f-91f8a5f1caf9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:09 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-0a3eb9ee-ba96-40d6-acdb-ebe6e5bdd282 req-b8bb7481-4d39-4fe9-9f6f-91f8a5f1caf9 service nova] Creating event network-vif-plugged:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:43:09 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-0a3eb9ee-ba96-40d6-acdb-ebe6e5bdd282 req-b8bb7481-4d39-4fe9-9f6f-91f8a5f1caf9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075046 Apr 14 10:43:09 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 29/83] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:09 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-7b63e332-42c8-4029-a6c5-a012190dd66e tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d67e170>, body: {"keypair": {"name": "tempest-keypair-1306588747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJOFZ8W37hnq+kD091gcZmfKt0DbPWyNzwj7yK+k5JHq+c+tzsMxH1HPOh1pMpymrDK+TpdkALjgZfKfob4LIzOz/KHG73qeijcsRYqyklipL4lvgFNZ8j26eWO1fqqtg=="}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:09 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:09 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-7b63e332-42c8-4029-a6c5-a012190dd66e tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Getting quotas for project 77068eae4fa9459fbe81026615d0c16d. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:43:09 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-7b63e332-42c8-4029-a6c5-a012190dd66e tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Getting quotas for user 806d72cf0d0f4de3a4b9f0466a8e094d and project 77068eae4fa9459fbe81026615d0c16d. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:43:10 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-7b63e332-42c8-4029-a6c5-a012190dd66e tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.617663 Apr 14 10:43:10 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 27/84] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 10:43:09 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:12 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1939318021", "imageRef": "ed0c452a-8d78-4384-a7fd-42b906083cfb", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "79481373-f78f-46b0-bda0-5e66dea2fd31"}], "security_groups": [{"name": "tempest-securitygroup--1574198537"}], "key_name": "tempest-keypair-1306588747", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:12 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] validate_networks() for [('79481373-f78f-46b0-bda0-5e66dea2fd31', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:43:13 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:43:13 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:43:13 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:43:13 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:43:13 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:43:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:13 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Getting quotas for project 77068eae4fa9459fbe81026615d0c16d. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:43:13 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Getting quotas for user 806d72cf0d0f4de3a4b9f0466a8e094d and project 77068eae4fa9459fbe81026615d0c16d. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:43:13 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:43:13 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ed0c452a-8d78-4384-a7fd-42b906083cfb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:43:13 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.316948 Apr 14 10:43:13 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 29/85] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:43:12 2023] POST /compute/v2.1/servers => generated 404 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 14 10:43:13 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-07a6e72c-d676-4787-9202-68320849cacf tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:43:13 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-07a6e72c-d676-4787-9202-68320849cacf tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:43:14 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-07a6e72c-d676-4787-9202-68320849cacf tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806d72cf0d0f4de3a4b9f0466a8e094d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77068eae4fa9459fbe81026615d0c16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:14 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-07a6e72c-d676-4787-9202-68320849cacf tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d" status: 200 len: 1240 microversion: 2.1 time: 0.118348 Apr 14 10:43:14 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 30/86] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:43:13 2023] GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d => generated 1240 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:43:17 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=14 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:17 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-193937c1-d49d-4071-a95b-456b43aa10ca tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d67d2d0>, body: {"keypair": {"name": "tempest-keypair-1731536774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdp8DvIWzTdfQlZzBSWMm9TWVpW4Azm62lnWvgtwkAByNAiB4NOgWADUm4IuHKDHgDw6vr4SDZiH+/UlF++dOtHWNBkJxFq/sQk6UhVQojd3P/v2dpPDWmyAw5MBNgqfg=="}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:17 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-193937c1-d49d-4071-a95b-456b43aa10ca tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Getting quotas for project 64094cc814374da59456a39ef9cd8cd2. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:43:17 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-193937c1-d49d-4071-a95b-456b43aa10ca tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Getting quotas for user e15c150540fa4d9c825a9ac81d674308 and project 64094cc814374da59456a39ef9cd8cd2. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:43:17 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-193937c1-d49d-4071-a95b-456b43aa10ca tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125777 Apr 14 10:43:17 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 28/87] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 10:43:17 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:18 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-6f97a914-49aa-4ec2-994d-7ef24cfa60b7 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d6a53f0>, body: {"keypair": {"name": "tempest-keypair-1362955333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg92rKWvJLt4w+A2kLtzcKlRZllCdVCDpTieGdgT9uh8Ad5t/MvIIcaNE/YQBHARvcYgshBiRX60EUhdlUvUMSVKsG5MBNdYdax1bLq6yx8+hLej82SZYaOv31/N253aw=="}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:18 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-6f97a914-49aa-4ec2-994d-7ef24cfa60b7 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Getting quotas for project fe8cdf0a5d7f49a9897167eb79dbfc39. Resources: {'key_pairs'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:43:18 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-6f97a914-49aa-4ec2-994d-7ef24cfa60b7 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Getting quotas for user c7ce31180e5946d4a027ae6ac9d136fa and project fe8cdf0a5d7f49a9897167eb79dbfc39. Resources: {'key_pairs'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:43:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-6f97a914-49aa-4ec2-994d-7ef24cfa60b7 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.078909 Apr 14 10:43:18 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 30/88] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 10:43:18 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 82 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 10:43:18 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-6887f3f8-0c57-4477-a1cb-5c21ec5d46de req-f2fce6e9-4451-4de0-a251-5cadf3595784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec16b4bc-5385-4eea-856f-710d52d0261d", "tag": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6887f3f8-0c57-4477-a1cb-5c21ec5d46de req-f2fce6e9-4451-4de0-a251-5cadf3595784 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6887f3f8-0c57-4477-a1cb-5c21ec5d46de req-f2fce6e9-4451-4de0-a251-5cadf3595784 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6887f3f8-0c57-4477-a1cb-5c21ec5d46de req-f2fce6e9-4451-4de0-a251-5cadf3595784 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:18 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-6887f3f8-0c57-4477-a1cb-5c21ec5d46de req-f2fce6e9-4451-4de0-a251-5cadf3595784 service nova] Creating event network-changed:2ee28d01-fbb2-4cf6-adcd-342fdabc8458 for instance ec16b4bc-5385-4eea-856f-710d52d0261d on user Apr 14 10:43:18 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-6887f3f8-0c57-4477-a1cb-5c21ec5d46de req-f2fce6e9-4451-4de0-a251-5cadf3595784 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058178 Apr 14 10:43:18 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 31/89] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:19 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-200701793", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "networks": [{"uuid": "18e10605-b5d7-4446-9cb7-34a989b33763"}], "security_groups": [{"name": "tempest-securitygroup--266344364"}], "key_name": "tempest-keypair-1731536774", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:20 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] validate_networks() for [('18e10605-b5d7-4446-9cb7-34a989b33763', None, None, None, None, None)] {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:43:20 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1767995033", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "d0f56839-45f6-4d90-9a69-0a5d300e3c53"}], "security_groups": [{"name": "tempest-securitygroup--1736073763"}], "key_name": "tempest-keypair-1362955333", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:21 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] validate_networks() for [('d0f56839-45f6-4d90-9a69-0a5d300e3c53', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Getting quotas for project 64094cc814374da59456a39ef9cd8cd2. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Getting quotas for user e15c150540fa4d9c825a9ac81d674308 and project 64094cc814374da59456a39ef9cd8cd2. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:43:21 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.730278 Apr 14 10:43:21 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 29/90] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:43:19 2023] POST /compute/v2.1/servers => generated 403 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:43:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-ddc7ecc9-1a2e-4661-b1c8-fccf2d94aeaa tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:43:21 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-ddc7ecc9-1a2e-4661-b1c8-fccf2d94aeaa tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-aebe8fb3-8f14-46c0-b04f-be5a0eb78365 req-b8cd23fc-635d-4850-a22f-fee94050ea27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec16b4bc-5385-4eea-856f-710d52d0261d", "name": "network-vif-plugged", "status": "completed", "tag": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-aebe8fb3-8f14-46c0-b04f-be5a0eb78365 req-b8cd23fc-635d-4850-a22f-fee94050ea27 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-aebe8fb3-8f14-46c0-b04f-be5a0eb78365 req-b8cd23fc-635d-4850-a22f-fee94050ea27 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-aebe8fb3-8f14-46c0-b04f-be5a0eb78365 req-b8cd23fc-635d-4850-a22f-fee94050ea27 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:21 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-aebe8fb3-8f14-46c0-b04f-be5a0eb78365 req-b8cd23fc-635d-4850-a22f-fee94050ea27 service nova] Creating event network-vif-plugged:2ee28d01-fbb2-4cf6-adcd-342fdabc8458 for instance ec16b4bc-5385-4eea-856f-710d52d0261d on user Apr 14 10:43:21 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-aebe8fb3-8f14-46c0-b04f-be5a0eb78365 req-b8cd23fc-635d-4850-a22f-fee94050ea27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049813 Apr 14 10:43:21 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 30/91] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:21 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-ddc7ecc9-1a2e-4661-b1c8-fccf2d94aeaa tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c150540fa4d9c825a9ac81d674308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64094cc814374da59456a39ef9cd8cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:21 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-ddc7ecc9-1a2e-4661-b1c8-fccf2d94aeaa tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564" status: 200 len: 1225 microversion: 2.1 time: 0.112761 Apr 14 10:43:21 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 32/92] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:43:21 2023] GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:43:21 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:43:21 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:43:21 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:43:21 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:43:21 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:43:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:21 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Getting quotas for project fe8cdf0a5d7f49a9897167eb79dbfc39. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:43:21 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Getting quotas for user c7ce31180e5946d4a027ae6ac9d136fa and project fe8cdf0a5d7f49a9897167eb79dbfc39. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:43:22 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:43:22 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:43:22 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 1.369522 Apr 14 10:43:22 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 31/93] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 10:43:20 2023] POST /compute/v2.1/servers => generated 404 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 10:43:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8bda9a93-3920-4b93-9660-ae5257aa7d4e tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:43:22 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-8bda9a93-3920-4b93-9660-ae5257aa7d4e tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:43:22 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-8bda9a93-3920-4b93-9660-ae5257aa7d4e tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce31180e5946d4a027ae6ac9d136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8cdf0a5d7f49a9897167eb79dbfc39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:22 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-8bda9a93-3920-4b93-9660-ae5257aa7d4e tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ce31180e5946d4a027ae6ac9d136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8cdf0a5d7f49a9897167eb79dbfc39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:22 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-8bda9a93-3920-4b93-9660-ae5257aa7d4e tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ce31180e5946d4a027ae6ac9d136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8cdf0a5d7f49a9897167eb79dbfc39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:22 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-8bda9a93-3920-4b93-9660-ae5257aa7d4e tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d" status: 200 len: 1321 microversion: 2.49 time: 0.097290 Apr 14 10:43:22 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 31/94] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:43:22 2023] GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d => generated 1321 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:43:23 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-75764197-0c8b-46bb-8fe0-44ec04143382 req-7d859391-3c4e-4e0d-b63b-e22befeb7793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec16b4bc-5385-4eea-856f-710d52d0261d", "name": "network-vif-plugged", "status": "completed", "tag": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-75764197-0c8b-46bb-8fe0-44ec04143382 req-7d859391-3c4e-4e0d-b63b-e22befeb7793 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-75764197-0c8b-46bb-8fe0-44ec04143382 req-7d859391-3c4e-4e0d-b63b-e22befeb7793 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-75764197-0c8b-46bb-8fe0-44ec04143382 req-7d859391-3c4e-4e0d-b63b-e22befeb7793 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:23 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=19 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:23 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-75764197-0c8b-46bb-8fe0-44ec04143382 req-7d859391-3c4e-4e0d-b63b-e22befeb7793 service nova] Creating event network-vif-plugged:2ee28d01-fbb2-4cf6-adcd-342fdabc8458 for instance ec16b4bc-5385-4eea-856f-710d52d0261d on user Apr 14 10:43:23 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-75764197-0c8b-46bb-8fe0-44ec04143382 req-7d859391-3c4e-4e0d-b63b-e22befeb7793 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052684 Apr 14 10:43:23 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 33/95] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:26 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-817a5a20-f8b2-4519-89c9-14be386dd733 req-d81b008c-5a0c-413c-99ae-5518dcfa700a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f539d8-4144-467b-ac69-44011c5b3564", "tag": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:26 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-817a5a20-f8b2-4519-89c9-14be386dd733 req-d81b008c-5a0c-413c-99ae-5518dcfa700a service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:26 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-817a5a20-f8b2-4519-89c9-14be386dd733 req-d81b008c-5a0c-413c-99ae-5518dcfa700a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:26 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-817a5a20-f8b2-4519-89c9-14be386dd733 req-d81b008c-5a0c-413c-99ae-5518dcfa700a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:26 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-817a5a20-f8b2-4519-89c9-14be386dd733 req-d81b008c-5a0c-413c-99ae-5518dcfa700a service nova] Creating event network-changed:d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 for instance d6f539d8-4144-467b-ac69-44011c5b3564 on user Apr 14 10:43:26 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-817a5a20-f8b2-4519-89c9-14be386dd733 req-d81b008c-5a0c-413c-99ae-5518dcfa700a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057168 Apr 14 10:43:26 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 32/96] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:26 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-18d9ac0e-1fb2-4752-977a-e783aed67527 req-4c31d249-935d-4ec0-8ee8-7072cb0644c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31f6ad8c-40d3-4b6e-af07-4848fafc431d", "tag": "edef0af3-01e9-4008-9017-119519f73981"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-18d9ac0e-1fb2-4752-977a-e783aed67527 req-4c31d249-935d-4ec0-8ee8-7072cb0644c5 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-18d9ac0e-1fb2-4752-977a-e783aed67527 req-4c31d249-935d-4ec0-8ee8-7072cb0644c5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-18d9ac0e-1fb2-4752-977a-e783aed67527 req-4c31d249-935d-4ec0-8ee8-7072cb0644c5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:27 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-18d9ac0e-1fb2-4752-977a-e783aed67527 req-4c31d249-935d-4ec0-8ee8-7072cb0644c5 service nova] Creating event network-changed:edef0af3-01e9-4008-9017-119519f73981 for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d on user Apr 14 10:43:27 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-18d9ac0e-1fb2-4752-977a-e783aed67527 req-4c31d249-935d-4ec0-8ee8-7072cb0644c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039144 Apr 14 10:43:27 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 32/97] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:29 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-583cdb23-b4e2-443a-b8ae-c3a6a300f8ce tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:43:29 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-583cdb23-b4e2-443a-b8ae-c3a6a300f8ce tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:43:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-583cdb23-b4e2-443a-b8ae-c3a6a300f8ce tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-583cdb23-b4e2-443a-b8ae-c3a6a300f8ce tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-583cdb23-b4e2-443a-b8ae-c3a6a300f8ce tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-583cdb23-b4e2-443a-b8ae-c3a6a300f8ce tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-583cdb23-b4e2-443a-b8ae-c3a6a300f8ce tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-583cdb23-b4e2-443a-b8ae-c3a6a300f8ce tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:30 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-583cdb23-b4e2-443a-b8ae-c3a6a300f8ce tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9842a4c91c4d45b52da0b404fc27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30856983340a435d8e92f138fdecaa35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:30 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-583cdb23-b4e2-443a-b8ae-c3a6a300f8ce tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a" status: 200 len: 1491 microversion: 2.1 time: 0.553324 Apr 14 10:43:30 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 34/98] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:43:29 2023] GET /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a => generated 1491 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:43:30 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-8aec832c-9a22-46cc-ba11-b6a678bfbee0 req-b0f48ca6-be87-470c-b8ff-a57900c492de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f539d8-4144-467b-ac69-44011c5b3564", "name": "network-vif-plugged", "status": "completed", "tag": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8aec832c-9a22-46cc-ba11-b6a678bfbee0 req-b0f48ca6-be87-470c-b8ff-a57900c492de service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8aec832c-9a22-46cc-ba11-b6a678bfbee0 req-b0f48ca6-be87-470c-b8ff-a57900c492de service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8aec832c-9a22-46cc-ba11-b6a678bfbee0 req-b0f48ca6-be87-470c-b8ff-a57900c492de service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:30 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-8aec832c-9a22-46cc-ba11-b6a678bfbee0 req-b0f48ca6-be87-470c-b8ff-a57900c492de service nova] Creating event network-vif-plugged:d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 for instance d6f539d8-4144-467b-ac69-44011c5b3564 on user Apr 14 10:43:30 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-8aec832c-9a22-46cc-ba11-b6a678bfbee0 req-b0f48ca6-be87-470c-b8ff-a57900c492de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051356 Apr 14 10:43:30 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 33/99] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:30 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-44bfe1d5-52f7-42cc-9424-050a8f9bb049 req-ca57e38a-64bc-41c7-9979-d0ffdcf1a797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f6ad8c-40d3-4b6e-af07-4848fafc431d", "name": "network-vif-plugged", "status": "completed", "tag": "edef0af3-01e9-4008-9017-119519f73981"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:30 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-44bfe1d5-52f7-42cc-9424-050a8f9bb049 req-ca57e38a-64bc-41c7-9979-d0ffdcf1a797 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:30 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-44bfe1d5-52f7-42cc-9424-050a8f9bb049 req-ca57e38a-64bc-41c7-9979-d0ffdcf1a797 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:30 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-44bfe1d5-52f7-42cc-9424-050a8f9bb049 req-ca57e38a-64bc-41c7-9979-d0ffdcf1a797 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:30 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-44bfe1d5-52f7-42cc-9424-050a8f9bb049 req-ca57e38a-64bc-41c7-9979-d0ffdcf1a797 service nova] Creating event network-vif-plugged:edef0af3-01e9-4008-9017-119519f73981 for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d on user Apr 14 10:43:31 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-44bfe1d5-52f7-42cc-9424-050a8f9bb049 req-ca57e38a-64bc-41c7-9979-d0ffdcf1a797 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117342 Apr 14 10:43:31 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 33/100] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-8f21ee98-6033-4616-b139-8442140832fb req-cece726a-f9f6-4d19-9c22-38001533f9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f539d8-4144-467b-ac69-44011c5b3564", "name": "network-vif-plugged", "status": "completed", "tag": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:32 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-8f21ee98-6033-4616-b139-8442140832fb req-cece726a-f9f6-4d19-9c22-38001533f9f9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-8f21ee98-6033-4616-b139-8442140832fb req-cece726a-f9f6-4d19-9c22-38001533f9f9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-8f21ee98-6033-4616-b139-8442140832fb req-cece726a-f9f6-4d19-9c22-38001533f9f9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:32 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-8f21ee98-6033-4616-b139-8442140832fb req-cece726a-f9f6-4d19-9c22-38001533f9f9 service nova] Creating event network-vif-plugged:d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 for instance d6f539d8-4144-467b-ac69-44011c5b3564 on user Apr 14 10:43:32 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-8f21ee98-6033-4616-b139-8442140832fb req-cece726a-f9f6-4d19-9c22-38001533f9f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092098 Apr 14 10:43:32 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 35/101] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:32 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:32 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=16 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:32 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-a53aacc6-d252-48e1-b83c-cb084acdc8ba tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:43:32 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-a53aacc6-d252-48e1-b83c-cb084acdc8ba tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:43:32 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=7 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a53aacc6-d252-48e1-b83c-cb084acdc8ba tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a53aacc6-d252-48e1-b83c-cb084acdc8ba tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a53aacc6-d252-48e1-b83c-cb084acdc8ba tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a53aacc6-d252-48e1-b83c-cb084acdc8ba tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a53aacc6-d252-48e1-b83c-cb084acdc8ba tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a53aacc6-d252-48e1-b83c-cb084acdc8ba tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:32 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=15 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:33 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-15f69858-437f-45c0-a37e-984b2a652189 req-cbba216c-7b80-444c-b378-13a3c5cb3478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f6ad8c-40d3-4b6e-af07-4848fafc431d", "name": "network-vif-plugged", "status": "completed", "tag": "edef0af3-01e9-4008-9017-119519f73981"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:33 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:33 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=16 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-15f69858-437f-45c0-a37e-984b2a652189 req-cbba216c-7b80-444c-b378-13a3c5cb3478 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-15f69858-437f-45c0-a37e-984b2a652189 req-cbba216c-7b80-444c-b378-13a3c5cb3478 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-15f69858-437f-45c0-a37e-984b2a652189 req-cbba216c-7b80-444c-b378-13a3c5cb3478 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:33 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-15f69858-437f-45c0-a37e-984b2a652189 req-cbba216c-7b80-444c-b378-13a3c5cb3478 service nova] Creating event network-vif-plugged:edef0af3-01e9-4008-9017-119519f73981 for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d on user Apr 14 10:43:33 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-15f69858-437f-45c0-a37e-984b2a652189 req-cbba216c-7b80-444c-b378-13a3c5cb3478 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051941 Apr 14 10:43:33 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 34/102] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:33 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-a53aacc6-d252-48e1-b83c-cb084acdc8ba tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:33 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-a53aacc6-d252-48e1-b83c-cb084acdc8ba tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a" status: 200 len: 1502 microversion: 2.1 time: 0.480790 Apr 14 10:43:33 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 34/103] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:43:32 2023] GET /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a => generated 1502 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:43:37 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-238083f4-496d-4cb5-bae7-147566f81bc4 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Action: 'create', calling method: .version_select at 0x7fcd1de9f760>, body: {"keypair": {"name": "tempest-TestShelveInstance-261961953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3ZHmXOyTBTmz/eyfbYxzCGMRdCEyszErL9xPCKFdEiRsMyb95B0M7mgiLexh904XoCh1bLLkQyrJ5ED+7iDH16ePICxxSDKO7GY80QCmCqc5cAXakERyNUFb4hTkOeQA=="}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:37 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-238083f4-496d-4cb5-bae7-147566f81bc4 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Getting quotas for project 340e1e1695464eb5ad8a8c881cf24611. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:43:37 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-238083f4-496d-4cb5-bae7-147566f81bc4 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Getting quotas for user 15c4ab86a8d244c4be5889b4ac47561a and project 340e1e1695464eb5ad8a8c881cf24611. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:43:37 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-238083f4-496d-4cb5-bae7-147566f81bc4 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.658328 Apr 14 10:43:37 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 36/104] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 10:43:36 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:39 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-588900252", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:39 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] validate_networks() for None {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:43:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-4b7e5637-025a-4cad-a947-58ee61a6fbc8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:43:40 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-4b7e5637-025a-4cad-a947-58ee61a6fbc8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=5 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4b7e5637-025a-4cad-a947-58ee61a6fbc8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4b7e5637-025a-4cad-a947-58ee61a6fbc8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4b7e5637-025a-4cad-a947-58ee61a6fbc8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4b7e5637-025a-4cad-a947-58ee61a6fbc8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4b7e5637-025a-4cad-a947-58ee61a6fbc8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4b7e5637-025a-4cad-a947-58ee61a6fbc8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Getting quotas for project 78792d5e25ef4c7aa31b0656dacdd9f4. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Getting quotas for user 187b7b3152ef496cbd84a94232d5ada5 and project 78792d5e25ef4c7aa31b0656dacdd9f4. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:43:40 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:43:40 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.898099 Apr 14 10:43:40 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 35/105] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:43:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:43:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-1eee8d10-0dbc-4e58-b094-fab1f24ce2de tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:43:40 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-1eee8d10-0dbc-4e58-b094-fab1f24ce2de tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:43:40 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:40 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-1eee8d10-0dbc-4e58-b094-fab1f24ce2de tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187b7b3152ef496cbd84a94232d5ada5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78792d5e25ef4c7aa31b0656dacdd9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-1eee8d10-0dbc-4e58-b094-fab1f24ce2de tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0e2af6d-3694-4166-a3d0-b5be1107c488" status: 200 len: 1208 microversion: 2.1 time: 0.111530 Apr 14 10:43:40 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 37/106] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:43:40 2023] GET /compute/v2.1/servers/c0e2af6d-3694-4166-a3d0-b5be1107c488 => generated 1208 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:43:40 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-4b7e5637-025a-4cad-a947-58ee61a6fbc8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-4b7e5637-025a-4cad-a947-58ee61a6fbc8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1538 microversion: 2.1 time: 0.510487 Apr 14 10:43:40 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 35/107] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:43:40 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1538 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:43:43 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-53a7e9e0-c4b5-4736-909c-2af8c0ba8fd0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d67c310>, body: {"keypair": {"name": "tempest-keypair-190287482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg=="}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:43 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-53a7e9e0-c4b5-4736-909c-2af8c0ba8fd0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Getting quotas for project f701119cef78433280cbddf2adf685db. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:43:43 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-53a7e9e0-c4b5-4736-909c-2af8c0ba8fd0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Getting quotas for user 3579ac20f8094f5a9fbd036ed05cda23 and project f701119cef78433280cbddf2adf685db. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:43:43 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-53a7e9e0-c4b5-4736-909c-2af8c0ba8fd0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.049196 Apr 14 10:43:43 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 36/108] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 10:43:43 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 10:43:44 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1022992671", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-261961953", "security_groups": [{"name": "tempest-secgroup-smoke-1483725585"}], "networks": [{"uuid": "69274626-4a94-46d8-be28-534a98fb6817"}], "block_device_mapping_v2": [{"uuid": "5647685a-aec6-4498-b1b4-372602a4c7ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:44 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=9 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:44 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-d6c303cb-7a30-4093-a381-2dc1973a6417 req-a0c9b2fc-0010-45ba-9c1e-6393dc9d6816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e2af6d-3694-4166-a3d0-b5be1107c488", "tag": "ade20134-2589-42de-8b15-051228d8d647"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-d6c303cb-7a30-4093-a381-2dc1973a6417 req-a0c9b2fc-0010-45ba-9c1e-6393dc9d6816 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-d6c303cb-7a30-4093-a381-2dc1973a6417 req-a0c9b2fc-0010-45ba-9c1e-6393dc9d6816 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-d6c303cb-7a30-4093-a381-2dc1973a6417 req-a0c9b2fc-0010-45ba-9c1e-6393dc9d6816 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-d6c303cb-7a30-4093-a381-2dc1973a6417 req-a0c9b2fc-0010-45ba-9c1e-6393dc9d6816 service nova] Creating event network-changed:ade20134-2589-42de-8b15-051228d8d647 for instance c0e2af6d-3694-4166-a3d0-b5be1107c488 on user Apr 14 10:43:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-d6c303cb-7a30-4093-a381-2dc1973a6417 req-a0c9b2fc-0010-45ba-9c1e-6393dc9d6816 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051311 Apr 14 10:43:44 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 36/109] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:44 user devstack@n-api.service[61841]: DEBUG nova.network.neutron [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] validate_networks() for [('69274626-4a94-46d8-be28-534a98fb6817', None, None, None, None, None)] {{(pid=61841) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:43:45 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Flavor limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:43:45 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Image limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:43:45 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Flavor pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:43:45 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Image pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:43:45 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:43:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:45 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Getting quotas for project 340e1e1695464eb5ad8a8c881cf24611. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:43:45 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Getting quotas for user 15c4ab86a8d244c4be5889b4ac47561a and project 340e1e1695464eb5ad8a8c881cf24611. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:43:45 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Going to run 1 instances... {{(pid=61841) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:43:45 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5647685a-aec6-4498-b1b4-372602a4c7ee',volume_size=None,volume_type=None)] {{(pid=61841) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:43:45 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.177540 Apr 14 10:43:45 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 38/110] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:43:44 2023] POST /compute/v2.1/servers => generated 404 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:43:45 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-1c9c53f2-849e-4ff1-a3be-d9cb1605ba3a tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:43:45 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-1c9c53f2-849e-4ff1-a3be-d9cb1605ba3a tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:43:45 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1778823491", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "e6a6e8f5-448a-41d1-a833-6db7058c611c"}, {"port": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "tag": "port-1"}, {"port": "d2d71e67-1807-43cf-8753-7bdd77de6317", "tag": "port-2"}, {"uuid": "a50bebb6-d4de-4875-9553-570535dace36", "tag": "net-1"}, {"uuid": "a50bebb6-d4de-4875-9553-570535dace36"}, {"uuid": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "2b354544-2f2e-40f1-bb9b-5f60c8497f18", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "18ba60c5-2a70-402c-a557-69dd9c886768", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7653f786-98b3-4e3d-b593-3b9fec984d92", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--188063853"}], "key_name": "tempest-keypair-190287482", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:45 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-1c9c53f2-849e-4ff1-a3be-d9cb1605ba3a tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c4ab86a8d244c4be5889b4ac47561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e1e1695464eb5ad8a8c881cf24611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:45 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-1c9c53f2-849e-4ff1-a3be-d9cb1605ba3a tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606" status: 200 len: 1083 microversion: 2.1 time: 0.111809 Apr 14 10:43:45 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 37/111] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:43:45 2023] GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606 => generated 1083 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:43:45 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] validate_networks() for [('e6a6e8f5-448a-41d1-a833-6db7058c611c', None, None, None, None, None), (None, None, 'f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7', None, None, None), (None, None, 'd2d71e67-1807-43cf-8753-7bdd77de6317', None, None, None), ('a50bebb6-d4de-4875-9553-570535dace36', None, None, None, None, None), ('a50bebb6-d4de-4875-9553-570535dace36', None, None, None, None, None), ('d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c', '10.2.2.100', None, None, None, None), ('d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c', '10.2.2.200', None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:43:46 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9f965f52-87b7-46c6-85c9-c53dd0e62d2b tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Action: 'create', calling method: .version_select at 0x7fcd1de9d900>, body: {"keypair": {"name": "tempest-keypair-1957800049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w=="}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:46 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-9f965f52-87b7-46c6-85c9-c53dd0e62d2b tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Getting quotas for project 0e024f5a578e4543a02c6adc7d456f39. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:43:46 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-9f965f52-87b7-46c6-85c9-c53dd0e62d2b tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Getting quotas for user 1f6dac34303f4965babaee39bb363b5e and project 0e024f5a578e4543a02c6adc7d456f39. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:43:46 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-9f965f52-87b7-46c6-85c9-c53dd0e62d2b tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.071244 Apr 14 10:43:46 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 39/112] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 10:43:46 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 10:43:46 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-33d53d2e-b1cf-4f3d-a0c4-270f3e21cf2e req-01385d20-31d5-45b5-b277-8ff75f4f6f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e2af6d-3694-4166-a3d0-b5be1107c488", "name": "network-vif-plugged", "status": "completed", "tag": "ade20134-2589-42de-8b15-051228d8d647"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-33d53d2e-b1cf-4f3d-a0c4-270f3e21cf2e req-01385d20-31d5-45b5-b277-8ff75f4f6f41 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-33d53d2e-b1cf-4f3d-a0c4-270f3e21cf2e req-01385d20-31d5-45b5-b277-8ff75f4f6f41 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-33d53d2e-b1cf-4f3d-a0c4-270f3e21cf2e req-01385d20-31d5-45b5-b277-8ff75f4f6f41 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-33d53d2e-b1cf-4f3d-a0c4-270f3e21cf2e req-01385d20-31d5-45b5-b277-8ff75f4f6f41 service nova] Creating event network-vif-plugged:ade20134-2589-42de-8b15-051228d8d647 for instance c0e2af6d-3694-4166-a3d0-b5be1107c488 on user Apr 14 10:43:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-33d53d2e-b1cf-4f3d-a0c4-270f3e21cf2e req-01385d20-31d5-45b5-b277-8ff75f4f6f41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034775 Apr 14 10:43:46 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 38/113] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:46 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-fea1c190-710c-4225-b47e-5c5faf1c442c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:43:46 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-fea1c190-710c-4225-b47e-5c5faf1c442c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:43:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fea1c190-710c-4225-b47e-5c5faf1c442c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fea1c190-710c-4225-b47e-5c5faf1c442c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fea1c190-710c-4225-b47e-5c5faf1c442c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fea1c190-710c-4225-b47e-5c5faf1c442c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fea1c190-710c-4225-b47e-5c5faf1c442c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fea1c190-710c-4225-b47e-5c5faf1c442c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:47 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-fea1c190-710c-4225-b47e-5c5faf1c442c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7212c3fe50ef465c99a0eefec4cbd753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482809b9148e408b84b156802a21a225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:47 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-fea1c190-710c-4225-b47e-5c5faf1c442c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce" status: 200 len: 1553 microversion: 2.1 time: 0.186297 Apr 14 10:43:47 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 40/114] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:43:46 2023] GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:43:48 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1636555058", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "3c95a463-71cf-446f-8214-5f52f2da54b7"}, {"port": "23214923-0217-4046-9a68-675f2ee8e42d", "tag": "port-1"}, {"port": "7f7db929-b2fd-4242-9d23-5d58a374f961", "tag": "port-2"}, {"uuid": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "tag": "net-1"}, {"uuid": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461"}, {"uuid": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "146f2d89-f831-40b0-a5cd-75a2761fb700", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a80b10a6-3148-4db6-842e-f343407b1171", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0d1e04e5-b8c3-4127-b22f-5535d2d28e7e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1842080309"}], "key_name": "tempest-keypair-1957800049", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:49 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-2d52fe88-9fe1-4154-96ac-531293e462d7 req-447d646a-6f6a-4b6e-96bf-a01b85581510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e2af6d-3694-4166-a3d0-b5be1107c488", "name": "network-vif-plugged", "status": "completed", "tag": "ade20134-2589-42de-8b15-051228d8d647"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-2d52fe88-9fe1-4154-96ac-531293e462d7 req-447d646a-6f6a-4b6e-96bf-a01b85581510 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-2d52fe88-9fe1-4154-96ac-531293e462d7 req-447d646a-6f6a-4b6e-96bf-a01b85581510 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-2d52fe88-9fe1-4154-96ac-531293e462d7 req-447d646a-6f6a-4b6e-96bf-a01b85581510 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:49 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-2d52fe88-9fe1-4154-96ac-531293e462d7 req-447d646a-6f6a-4b6e-96bf-a01b85581510 service nova] Creating event network-vif-plugged:ade20134-2589-42de-8b15-051228d8d647 for instance c0e2af6d-3694-4166-a3d0-b5be1107c488 on user Apr 14 10:43:49 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-2d52fe88-9fe1-4154-96ac-531293e462d7 req-447d646a-6f6a-4b6e-96bf-a01b85581510 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042464 Apr 14 10:43:49 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 41/115] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:43:49 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] validate_networks() for [('3c95a463-71cf-446f-8214-5f52f2da54b7', None, None, None, None, None), (None, None, '23214923-0217-4046-9a68-675f2ee8e42d', None, None, None), (None, None, '7f7db929-b2fd-4242-9d23-5d58a374f961', None, None, None), ('bb8c5688-db8f-47c0-a2b5-0a44d2f97461', None, None, None, None, None), ('bb8c5688-db8f-47c0-a2b5-0a44d2f97461', None, None, None, None, None), ('1c6521c7-7280-4952-b1bc-a3aa0918e27c', '10.2.2.100', None, None, None, None), ('1c6521c7-7280-4952-b1bc-a3aa0918e27c', '10.2.2.200', None, None, None, None)] {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:43:49 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:43:49 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:43:49 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:43:49 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:43:49 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:43:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:50 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Getting quotas for project f701119cef78433280cbddf2adf685db. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:43:50 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Getting quotas for user 3579ac20f8094f5a9fbd036ed05cda23 and project f701119cef78433280cbddf2adf685db. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:43:50 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:43:50 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='2b354544-2f2e-40f1-bb9b-5f60c8497f18',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='18ba60c5-2a70-402c-a557-69dd9c886768',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7653f786-98b3-4e3d-b593-3b9fec984d92',volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:43:50 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 5.080812 Apr 14 10:43:50 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 37/116] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 10:43:45 2023] POST /compute/v2.1/servers => generated 403 bytes in 5085 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 10:43:50 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-6922324a-5295-4cc3-93b6-924560da40a2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:43:50 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-6922324a-5295-4cc3-93b6-924560da40a2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:43:50 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-6922324a-5295-4cc3-93b6-924560da40a2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3579ac20f8094f5a9fbd036ed05cda23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f701119cef78433280cbddf2adf685db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:50 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-6922324a-5295-4cc3-93b6-924560da40a2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3579ac20f8094f5a9fbd036ed05cda23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f701119cef78433280cbddf2adf685db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:50 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-6922324a-5295-4cc3-93b6-924560da40a2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3579ac20f8094f5a9fbd036ed05cda23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f701119cef78433280cbddf2adf685db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-6922324a-5295-4cc3-93b6-924560da40a2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca" status: 200 len: 1279 microversion: 2.42 time: 0.104166 Apr 14 10:43:50 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 42/117] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:43:50 2023] GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:43:51 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-aa8ca454-7dba-4b15-ad06-f70ac36d5968 req-3d4342ae-7b03-4c96-ae55-dd735e6790e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39586d44-1d8e-4607-ab4d-c03a7d841606", "tag": "6099437e-5607-4a06-abcb-15d465c7ecf8"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-aa8ca454-7dba-4b15-ad06-f70ac36d5968 req-3d4342ae-7b03-4c96-ae55-dd735e6790e6 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-aa8ca454-7dba-4b15-ad06-f70ac36d5968 req-3d4342ae-7b03-4c96-ae55-dd735e6790e6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-aa8ca454-7dba-4b15-ad06-f70ac36d5968 req-3d4342ae-7b03-4c96-ae55-dd735e6790e6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:51 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-aa8ca454-7dba-4b15-ad06-f70ac36d5968 req-3d4342ae-7b03-4c96-ae55-dd735e6790e6 service nova] Creating event network-changed:6099437e-5607-4a06-abcb-15d465c7ecf8 for instance 39586d44-1d8e-4607-ab4d-c03a7d841606 on user Apr 14 10:43:51 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-aa8ca454-7dba-4b15-ad06-f70ac36d5968 req-3d4342ae-7b03-4c96-ae55-dd735e6790e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036688 Apr 14 10:43:51 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 38/118] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=15 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Getting quotas for project 0e024f5a578e4543a02c6adc7d456f39. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Getting quotas for user 1f6dac34303f4965babaee39bb363b5e and project 0e024f5a578e4543a02c6adc7d456f39. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:43:54 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='146f2d89-f831-40b0-a5cd-75a2761fb700',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a80b10a6-3148-4db6-842e-f343407b1171',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0d1e04e5-b8c3-4127-b22f-5535d2d28e7e',volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:43:54 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 6.099431 Apr 14 10:43:54 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 39/119] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 10:43:48 2023] POST /compute/v2.1/servers => generated 404 bytes in 6101 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 10:43:54 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-c49158df-dc5c-43f7-a0cd-0569291ce8ab tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:43:54 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-c49158df-dc5c-43f7-a0cd-0569291ce8ab tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:43:55 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-c49158df-dc5c-43f7-a0cd-0569291ce8ab tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6dac34303f4965babaee39bb363b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e024f5a578e4543a02c6adc7d456f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:55 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-c49158df-dc5c-43f7-a0cd-0569291ce8ab tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f6dac34303f4965babaee39bb363b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e024f5a578e4543a02c6adc7d456f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:55 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-c49158df-dc5c-43f7-a0cd-0569291ce8ab tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f6dac34303f4965babaee39bb363b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e024f5a578e4543a02c6adc7d456f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:43:55 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-c49158df-dc5c-43f7-a0cd-0569291ce8ab tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e" status: 200 len: 1280 microversion: 2.32 time: 0.129877 Apr 14 10:43:55 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 43/120] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:43:54 2023] GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e => generated 1280 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:43:58 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-8fbb37c9-ecb8-4ef7-97ab-5bc8af71b8c6 req-aa9e9fc0-8412-435c-957c-84c5322c17ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39586d44-1d8e-4607-ab4d-c03a7d841606", "name": "network-vif-plugged", "status": "completed", "tag": "6099437e-5607-4a06-abcb-15d465c7ecf8"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8fbb37c9-ecb8-4ef7-97ab-5bc8af71b8c6 req-aa9e9fc0-8412-435c-957c-84c5322c17ea service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8fbb37c9-ecb8-4ef7-97ab-5bc8af71b8c6 req-aa9e9fc0-8412-435c-957c-84c5322c17ea service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8fbb37c9-ecb8-4ef7-97ab-5bc8af71b8c6 req-aa9e9fc0-8412-435c-957c-84c5322c17ea service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:58 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-8fbb37c9-ecb8-4ef7-97ab-5bc8af71b8c6 req-aa9e9fc0-8412-435c-957c-84c5322c17ea service nova] Creating event network-vif-plugged:6099437e-5607-4a06-abcb-15d465c7ecf8 for instance 39586d44-1d8e-4607-ab4d-c03a7d841606 on user Apr 14 10:43:58 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-8fbb37c9-ecb8-4ef7-97ab-5bc8af71b8c6 req-aa9e9fc0-8412-435c-957c-84c5322c17ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050415 Apr 14 10:43:58 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 39/121] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:43:59 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-0a6f4345-5b07-40d7-bab8-4806e1d2d0ba req-6cce97a9-6f0c-4c2f-8dc9-ef668e489a31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "tag": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:43:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-0a6f4345-5b07-40d7-bab8-4806e1d2d0ba req-6cce97a9-6f0c-4c2f-8dc9-ef668e489a31 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:43:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-0a6f4345-5b07-40d7-bab8-4806e1d2d0ba req-6cce97a9-6f0c-4c2f-8dc9-ef668e489a31 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:43:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-0a6f4345-5b07-40d7-bab8-4806e1d2d0ba req-6cce97a9-6f0c-4c2f-8dc9-ef668e489a31 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:43:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-0a6f4345-5b07-40d7-bab8-4806e1d2d0ba req-6cce97a9-6f0c-4c2f-8dc9-ef668e489a31 service nova] Creating event network-changed:2b341364-55e1-439f-9a3b-2b2fb7ad33b7 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:43:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-0a6f4345-5b07-40d7-bab8-4806e1d2d0ba req-6cce97a9-6f0c-4c2f-8dc9-ef668e489a31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036506 Apr 14 10:43:59 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 40/122] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:43:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:00 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:00 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=10 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:00 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a2b8c441-8345-4ad1-bfa5-37c125678773 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Action: 'create', calling method: .version_select at 0x7fcd1de9d900>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1664538954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSZXoy0ZdK7cT5ThMrTCya3wT94LWqxCTxtoLlDfoPgpqTWYvxs++wU1EdRWtZGKR5gH7hqEFS1U5I74nJs0Y4cHLUyVecAGHi5EkH+m7SY22DQORJXW8M8RwAfpcYDAg=="}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:00 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:00 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:00 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-444fdce6-cabc-417c-9106-f4ec04d95b51 req-610b479b-f65b-41fe-ac73-57f9285e21d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39586d44-1d8e-4607-ab4d-c03a7d841606", "name": "network-vif-plugged", "status": "completed", "tag": "6099437e-5607-4a06-abcb-15d465c7ecf8"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:00 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-a2b8c441-8345-4ad1-bfa5-37c125678773 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Getting quotas for project 1696bf804b2e4d7f86162513015c8e52. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:44:00 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-a2b8c441-8345-4ad1-bfa5-37c125678773 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Getting quotas for user 09ed4663d8984fe7b5d95616281bfbfc and project 1696bf804b2e4d7f86162513015c8e52. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:44:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-444fdce6-cabc-417c-9106-f4ec04d95b51 req-610b479b-f65b-41fe-ac73-57f9285e21d0 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-444fdce6-cabc-417c-9106-f4ec04d95b51 req-610b479b-f65b-41fe-ac73-57f9285e21d0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-444fdce6-cabc-417c-9106-f4ec04d95b51 req-610b479b-f65b-41fe-ac73-57f9285e21d0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:00 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-444fdce6-cabc-417c-9106-f4ec04d95b51 req-610b479b-f65b-41fe-ac73-57f9285e21d0 service nova] Creating event network-vif-plugged:6099437e-5607-4a06-abcb-15d465c7ecf8 for instance 39586d44-1d8e-4607-ab4d-c03a7d841606 on user Apr 14 10:44:00 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a2b8c441-8345-4ad1-bfa5-37c125678773 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.252790 Apr 14 10:44:00 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 44/123] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 10:44:00 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:00 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-444fdce6-cabc-417c-9106-f4ec04d95b51 req-610b479b-f65b-41fe-ac73-57f9285e21d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044445 Apr 14 10:44:00 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 40/124] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:44:01 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-06b65906-86d9-4045-ae7b-fe4bb61dcafc req-3b6b36c6-a720-4b96-b7b5-90b7bb7e7020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "tag": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:01 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-06b65906-86d9-4045-ae7b-fe4bb61dcafc req-3b6b36c6-a720-4b96-b7b5-90b7bb7e7020 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:01 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-06b65906-86d9-4045-ae7b-fe4bb61dcafc req-3b6b36c6-a720-4b96-b7b5-90b7bb7e7020 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:01 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-06b65906-86d9-4045-ae7b-fe4bb61dcafc req-3b6b36c6-a720-4b96-b7b5-90b7bb7e7020 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:01 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-06b65906-86d9-4045-ae7b-fe4bb61dcafc req-3b6b36c6-a720-4b96-b7b5-90b7bb7e7020 service nova] Creating event network-changed:f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:01 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-06b65906-86d9-4045-ae7b-fe4bb61dcafc req-3b6b36c6-a720-4b96-b7b5-90b7bb7e7020 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031987 Apr 14 10:44:01 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 41/125] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-36028895", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1664538954", "security_groups": [{"name": "tempest-secgroup-smoke-1393434070"}], "networks": [{"uuid": "cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd"}]}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG nova.network.neutron [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] validate_networks() for [('cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd', None, None, None, None, None)] {{(pid=61841) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Flavor limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Image limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Flavor pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Image pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=25 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Getting quotas for project 1696bf804b2e4d7f86162513015c8e52. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Getting quotas for user 09ed4663d8984fe7b5d95616281bfbfc and project 1696bf804b2e4d7f86162513015c8e52. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Going to run 1 instances... {{(pid=61841) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:44:02 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61841) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:44:03 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.796133 Apr 14 10:44:03 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 45/126] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:44:02 2023] POST /compute/v2.1/servers => generated 404 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:44:03 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-1331f75f-a5ba-4b43-a914-4606105ec182 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:03 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-1331f75f-a5ba-4b43-a914-4606105ec182 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:03 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:03 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-1331f75f-a5ba-4b43-a914-4606105ec182 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ed4663d8984fe7b5d95616281bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1696bf804b2e4d7f86162513015c8e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:03 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-1331f75f-a5ba-4b43-a914-4606105ec182 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c" status: 200 len: 1255 microversion: 2.1 time: 0.094471 Apr 14 10:44:03 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 41/127] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:44:03 2023] GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c => generated 1255 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:44:03 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "tag": "d2d71e67-1807-43cf-8753-7bdd77de6317"}, {"name": "network-changed", "server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "tag": "c46b5082-6634-4c7f-89c1-7e58a3cd8987"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:03 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] Creating event network-changed:d2d71e67-1807-43cf-8753-7bdd77de6317 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:03 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] Creating event network-changed:c46b5082-6634-4c7f-89c1-7e58a3cd8987 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:03 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070189 Apr 14 10:44:03 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 42/128] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:03 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:03 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-b43585ac-4307-476c-b423-ea4de98d2abe req-aa1fe73d-741e-4c05-bfda-106367918d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "tag": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-b43585ac-4307-476c-b423-ea4de98d2abe req-aa1fe73d-741e-4c05-bfda-106367918d69 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-b43585ac-4307-476c-b423-ea4de98d2abe req-aa1fe73d-741e-4c05-bfda-106367918d69 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-b43585ac-4307-476c-b423-ea4de98d2abe req-aa1fe73d-741e-4c05-bfda-106367918d69 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:03 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-b43585ac-4307-476c-b423-ea4de98d2abe req-aa1fe73d-741e-4c05-bfda-106367918d69 service nova] Creating event network-changed:2a2ef05a-2d58-4cdf-ab6c-35df823a68bc for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:03 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-b43585ac-4307-476c-b423-ea4de98d2abe req-aa1fe73d-741e-4c05-bfda-106367918d69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073375 Apr 14 10:44:03 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 46/129] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:04 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-85fb81a2-4b1e-4c8f-885f-a2377afedc68 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:04 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-85fb81a2-4b1e-4c8f-885f-a2377afedc68 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-85fb81a2-4b1e-4c8f-885f-a2377afedc68 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-85fb81a2-4b1e-4c8f-885f-a2377afedc68 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-85fb81a2-4b1e-4c8f-885f-a2377afedc68 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-85fb81a2-4b1e-4c8f-885f-a2377afedc68 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-85fb81a2-4b1e-4c8f-885f-a2377afedc68 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-85fb81a2-4b1e-4c8f-885f-a2377afedc68 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:04 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=22 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:04 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-85fb81a2-4b1e-4c8f-885f-a2377afedc68 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806d72cf0d0f4de3a4b9f0466a8e094d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77068eae4fa9459fbe81026615d0c16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:04 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-85fb81a2-4b1e-4c8f-885f-a2377afedc68 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d" status: 200 len: 1550 microversion: 2.1 time: 0.743107 Apr 14 10:44:04 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 42/130] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:44:04 2023] GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d => generated 1550 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:44:05 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:05 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=18 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:05 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-451921fe-2cfe-4665-a3ed-b5de497f190b req-c96ca034-8f65-4d21-95bc-3c55c1bee5dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "tag": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-451921fe-2cfe-4665-a3ed-b5de497f190b req-c96ca034-8f65-4d21-95bc-3c55c1bee5dc service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-451921fe-2cfe-4665-a3ed-b5de497f190b req-c96ca034-8f65-4d21-95bc-3c55c1bee5dc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-451921fe-2cfe-4665-a3ed-b5de497f190b req-c96ca034-8f65-4d21-95bc-3c55c1bee5dc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:05 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-451921fe-2cfe-4665-a3ed-b5de497f190b req-c96ca034-8f65-4d21-95bc-3c55c1bee5dc service nova] Creating event network-changed:8789c03e-397c-439a-8bc5-5d8ce5fc36ac for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:05 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-451921fe-2cfe-4665-a3ed-b5de497f190b req-c96ca034-8f65-4d21-95bc-3c55c1bee5dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036340 Apr 14 10:44:05 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 43/131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:05 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-6e4b5846-3e25-47d8-a6f3-8d2ea4a0596b req-0712ec75-f771-4138-9854-9ab2861e96b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "tag": "23214923-0217-4046-9a68-675f2ee8e42d"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6e4b5846-3e25-47d8-a6f3-8d2ea4a0596b req-0712ec75-f771-4138-9854-9ab2861e96b5 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6e4b5846-3e25-47d8-a6f3-8d2ea4a0596b req-0712ec75-f771-4138-9854-9ab2861e96b5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6e4b5846-3e25-47d8-a6f3-8d2ea4a0596b req-0712ec75-f771-4138-9854-9ab2861e96b5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-6e4b5846-3e25-47d8-a6f3-8d2ea4a0596b req-0712ec75-f771-4138-9854-9ab2861e96b5 service nova] Creating event network-changed:23214923-0217-4046-9a68-675f2ee8e42d for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-6e4b5846-3e25-47d8-a6f3-8d2ea4a0596b req-0712ec75-f771-4138-9854-9ab2861e96b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031723 Apr 14 10:44:05 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 47/132] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:07 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "tag": "7f7db929-b2fd-4242-9d23-5d58a374f961"}, {"name": "network-changed", "server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "tag": "4d65e4a1-4cea-4636-8ad8-21065de3c747"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:07 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:07 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:07 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:07 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] Creating event network-changed:7f7db929-b2fd-4242-9d23-5d58a374f961 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:07 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] Creating event network-changed:4d65e4a1-4cea-4636-8ad8-21065de3c747 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:07 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038943 Apr 14 10:44:07 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 43/133] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:07 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:07 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-5f22d346-d873-42a5-aa62-a737221d7c9c req-c847d33c-72a9-463d-9290-7b5d36c8c28f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "tag": "84e561e8-01c6-4d50-ab37-bc64b5509e31"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-5f22d346-d873-42a5-aa62-a737221d7c9c req-c847d33c-72a9-463d-9290-7b5d36c8c28f service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-5f22d346-d873-42a5-aa62-a737221d7c9c req-c847d33c-72a9-463d-9290-7b5d36c8c28f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-5f22d346-d873-42a5-aa62-a737221d7c9c req-c847d33c-72a9-463d-9290-7b5d36c8c28f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:07 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-5f22d346-d873-42a5-aa62-a737221d7c9c req-c847d33c-72a9-463d-9290-7b5d36c8c28f service nova] Creating event network-changed:84e561e8-01c6-4d50-ab37-bc64b5509e31 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:07 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-5f22d346-d873-42a5-aa62-a737221d7c9c req-c847d33c-72a9-463d-9290-7b5d36c8c28f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029637 Apr 14 10:44:07 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 44/134] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:09 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "tag": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f"}, {"name": "network-changed", "server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "tag": "328d2b64-7bc6-425a-b3a4-8cda754ffd56"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:09 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] Creating event network-changed:d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:09 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] Creating event network-changed:328d2b64-7bc6-425a-b3a4-8cda754ffd56 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:09 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058303 Apr 14 10:44:09 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 48/135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:09 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:09 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55178126-9766-4875-9122-39dcc87ce82c", "tag": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f"}, {"name": "network-changed", "server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "tag": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:09 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:09 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:09 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:09 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] Creating event network-changed:578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance 55178126-9766-4875-9122-39dcc87ce82c on user Apr 14 10:44:09 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] Creating event network-changed:717e6c20-676e-40f2-b4c1-47ca0f3e6f22 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:09 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039734 Apr 14 10:44:09 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 44/136] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:09 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:11 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-4e232eae-1d94-4107-bcc4-502b4e6e7105 req-f26e75ef-f41f-43b1-808b-7d36409e24aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55178126-9766-4875-9122-39dcc87ce82c", "name": "network-vif-plugged", "status": "completed", "tag": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:11 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=7 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4e232eae-1d94-4107-bcc4-502b4e6e7105 req-f26e75ef-f41f-43b1-808b-7d36409e24aa service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4e232eae-1d94-4107-bcc4-502b4e6e7105 req-f26e75ef-f41f-43b1-808b-7d36409e24aa service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4e232eae-1d94-4107-bcc4-502b4e6e7105 req-f26e75ef-f41f-43b1-808b-7d36409e24aa service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:11 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-7d032106-7d03-4a63-94a1-a407bd54ee0d tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:11 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-7d032106-7d03-4a63-94a1-a407bd54ee0d tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:11 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-4e232eae-1d94-4107-bcc4-502b4e6e7105 req-f26e75ef-f41f-43b1-808b-7d36409e24aa service nova] Creating event network-vif-plugged:578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance 55178126-9766-4875-9122-39dcc87ce82c on user Apr 14 10:44:11 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=8 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:11 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-4e232eae-1d94-4107-bcc4-502b4e6e7105 req-f26e75ef-f41f-43b1-808b-7d36409e24aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034024 Apr 14 10:44:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7d032106-7d03-4a63-94a1-a407bd54ee0d tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7d032106-7d03-4a63-94a1-a407bd54ee0d tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:11 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 45/137] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7d032106-7d03-4a63-94a1-a407bd54ee0d tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7d032106-7d03-4a63-94a1-a407bd54ee0d tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7d032106-7d03-4a63-94a1-a407bd54ee0d tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7d032106-7d03-4a63-94a1-a407bd54ee0d tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:11 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-14a0426d-5eee-47fe-8105-1e04031d30dc req-aa4e21af-b69a-402a-b983-4c2ea16871f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "tag": "6e295a29-0297-49c0-9298-7d3a41a07585"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-14a0426d-5eee-47fe-8105-1e04031d30dc req-aa4e21af-b69a-402a-b983-4c2ea16871f7 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-14a0426d-5eee-47fe-8105-1e04031d30dc req-aa4e21af-b69a-402a-b983-4c2ea16871f7 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-14a0426d-5eee-47fe-8105-1e04031d30dc req-aa4e21af-b69a-402a-b983-4c2ea16871f7 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:11 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-14a0426d-5eee-47fe-8105-1e04031d30dc req-aa4e21af-b69a-402a-b983-4c2ea16871f7 service nova] Creating event network-changed:6e295a29-0297-49c0-9298-7d3a41a07585 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:11 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-14a0426d-5eee-47fe-8105-1e04031d30dc req-aa4e21af-b69a-402a-b983-4c2ea16871f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054613 Apr 14 10:44:11 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 45/138] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:12 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-7d032106-7d03-4a63-94a1-a407bd54ee0d tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c150540fa4d9c825a9ac81d674308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64094cc814374da59456a39ef9cd8cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:12 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-7d032106-7d03-4a63-94a1-a407bd54ee0d tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564" status: 200 len: 1524 microversion: 2.1 time: 0.498327 Apr 14 10:44:12 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 49/139] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:44:11 2023] GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564 => generated 1524 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:44:12 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-e9c3d298-0950-4258-a4a6-b467d9fe6a20 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:12 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-e9c3d298-0950-4258-a4a6-b467d9fe6a20 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e9c3d298-0950-4258-a4a6-b467d9fe6a20 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e9c3d298-0950-4258-a4a6-b467d9fe6a20 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e9c3d298-0950-4258-a4a6-b467d9fe6a20 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e9c3d298-0950-4258-a4a6-b467d9fe6a20 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e9c3d298-0950-4258-a4a6-b467d9fe6a20 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e9c3d298-0950-4258-a4a6-b467d9fe6a20 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:12 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-e9c3d298-0950-4258-a4a6-b467d9fe6a20 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce31180e5946d4a027ae6ac9d136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8cdf0a5d7f49a9897167eb79dbfc39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:12 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-e9c3d298-0950-4258-a4a6-b467d9fe6a20 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ce31180e5946d4a027ae6ac9d136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8cdf0a5d7f49a9897167eb79dbfc39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:12 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-e9c3d298-0950-4258-a4a6-b467d9fe6a20 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ce31180e5946d4a027ae6ac9d136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8cdf0a5d7f49a9897167eb79dbfc39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:12 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-e9c3d298-0950-4258-a4a6-b467d9fe6a20 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d" status: 200 len: 1627 microversion: 2.49 time: 0.360351 Apr 14 10:44:12 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 46/140] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:44:12 2023] GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d => generated 1627 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:44:13 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-6af543d3-4862-4338-9f23-7205d8ea2715 req-00331fce-b0e9-435b-91d7-f797312a4c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55178126-9766-4875-9122-39dcc87ce82c", "name": "network-vif-plugged", "status": "completed", "tag": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:13 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6af543d3-4862-4338-9f23-7205d8ea2715 req-00331fce-b0e9-435b-91d7-f797312a4c3c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6af543d3-4862-4338-9f23-7205d8ea2715 req-00331fce-b0e9-435b-91d7-f797312a4c3c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6af543d3-4862-4338-9f23-7205d8ea2715 req-00331fce-b0e9-435b-91d7-f797312a4c3c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:13 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-6af543d3-4862-4338-9f23-7205d8ea2715 req-00331fce-b0e9-435b-91d7-f797312a4c3c service nova] Creating event network-vif-plugged:578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance 55178126-9766-4875-9122-39dcc87ce82c on user Apr 14 10:44:13 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-6af543d3-4862-4338-9f23-7205d8ea2715 req-00331fce-b0e9-435b-91d7-f797312a4c3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062667 Apr 14 10:44:13 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 46/141] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-bc9f0f37-0ce0-44f9-bf39-8af96d2420e1 req-0011cbbe-dbfe-4b71-8295-0a7e1eb53e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:21 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:21 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=5 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-bc9f0f37-0ce0-44f9-bf39-8af96d2420e1 req-0011cbbe-dbfe-4b71-8295-0a7e1eb53e4c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-bc9f0f37-0ce0-44f9-bf39-8af96d2420e1 req-0011cbbe-dbfe-4b71-8295-0a7e1eb53e4c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-bc9f0f37-0ce0-44f9-bf39-8af96d2420e1 req-0011cbbe-dbfe-4b71-8295-0a7e1eb53e4c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:21 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-bc9f0f37-0ce0-44f9-bf39-8af96d2420e1 req-0011cbbe-dbfe-4b71-8295-0a7e1eb53e4c service nova] Creating event network-vif-plugged:2b341364-55e1-439f-9a3b-2b2fb7ad33b7 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:21 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-bc9f0f37-0ce0-44f9-bf39-8af96d2420e1 req-0011cbbe-dbfe-4b71-8295-0a7e1eb53e4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050516 Apr 14 10:44:21 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 50/142] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:23 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-a1946755-a6b7-43b2-89f0-514728863183 req-fcdd2b51-ff82-4dda-bf6b-7f2f6ac6d6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:23 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=3 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:23 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=19 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-a1946755-a6b7-43b2-89f0-514728863183 req-fcdd2b51-ff82-4dda-bf6b-7f2f6ac6d6fb service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-a1946755-a6b7-43b2-89f0-514728863183 req-fcdd2b51-ff82-4dda-bf6b-7f2f6ac6d6fb service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-a1946755-a6b7-43b2-89f0-514728863183 req-fcdd2b51-ff82-4dda-bf6b-7f2f6ac6d6fb service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:23 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-a1946755-a6b7-43b2-89f0-514728863183 req-fcdd2b51-ff82-4dda-bf6b-7f2f6ac6d6fb service nova] Creating event network-vif-plugged:8789c03e-397c-439a-8bc5-5d8ce5fc36ac for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:23 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-a1946755-a6b7-43b2-89f0-514728863183 req-fcdd2b51-ff82-4dda-bf6b-7f2f6ac6d6fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045388 Apr 14 10:44:23 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 47/143] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:23 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "d2d71e67-1807-43cf-8753-7bdd77de6317"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "d2d71e67-1807-43cf-8753-7bdd77de6317"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "c46b5082-6634-4c7f-89c1-7e58a3cd8987"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "c46b5082-6634-4c7f-89c1-7e58a3cd8987"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:23 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=13 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:23 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=13 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:23 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:23 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:23 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:23 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Creating event network-vif-plugged:2b341364-55e1-439f-9a3b-2b2fb7ad33b7 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:23 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Creating event network-vif-plugged:f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:23 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Creating event network-vif-plugged:f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:23 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Creating event network-vif-plugged:d2d71e67-1807-43cf-8753-7bdd77de6317 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:23 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Creating event network-vif-plugged:d2d71e67-1807-43cf-8753-7bdd77de6317 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:23 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Creating event network-vif-plugged:c46b5082-6634-4c7f-89c1-7e58a3cd8987 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:23 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Creating event network-vif-plugged:c46b5082-6634-4c7f-89c1-7e58a3cd8987 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:23 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.054418 Apr 14 10:44:23 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 47/144] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 10:44:23 2023] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:44:25 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:25 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Creating event network-vif-plugged:8789c03e-397c-439a-8bc5-5d8ce5fc36ac for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:25 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Creating event network-vif-plugged:717e6c20-676e-40f2-b4c1-47ca0f3e6f22 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:25 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Creating event network-vif-plugged:717e6c20-676e-40f2-b4c1-47ca0f3e6f22 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:25 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041824 Apr 14 10:44:25 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 51/145] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:25 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:44:25 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "84e561e8-01c6-4d50-ab37-bc64b5509e31"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "84e561e8-01c6-4d50-ab37-bc64b5509e31"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:25 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Creating event network-vif-plugged:84e561e8-01c6-4d50-ab37-bc64b5509e31 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:25 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Creating event network-vif-plugged:84e561e8-01c6-4d50-ab37-bc64b5509e31 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:44:25 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Creating event network-vif-plugged:2a2ef05a-2d58-4cdf-ab6c-35df823a68bc for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:25 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044192 Apr 14 10:44:25 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 48/146] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:25 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:26 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-7a0380ca-2ea3-4b0d-9759-2f536fc41a97 req-fc087e75-2d0c-41dd-9741-35aaa93f2dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "23214923-0217-4046-9a68-675f2ee8e42d"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:26 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-7a0380ca-2ea3-4b0d-9759-2f536fc41a97 req-fc087e75-2d0c-41dd-9741-35aaa93f2dd2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:26 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-7a0380ca-2ea3-4b0d-9759-2f536fc41a97 req-fc087e75-2d0c-41dd-9741-35aaa93f2dd2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:26 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-7a0380ca-2ea3-4b0d-9759-2f536fc41a97 req-fc087e75-2d0c-41dd-9741-35aaa93f2dd2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:26 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-7a0380ca-2ea3-4b0d-9759-2f536fc41a97 req-fc087e75-2d0c-41dd-9741-35aaa93f2dd2 service nova] Creating event network-vif-plugged:23214923-0217-4046-9a68-675f2ee8e42d for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:26 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-7a0380ca-2ea3-4b0d-9759-2f536fc41a97 req-fc087e75-2d0c-41dd-9741-35aaa93f2dd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035988 Apr 14 10:44:26 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 48/147] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:27 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "7f7db929-b2fd-4242-9d23-5d58a374f961"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "7f7db929-b2fd-4242-9d23-5d58a374f961"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "328d2b64-7bc6-425a-b3a4-8cda754ffd56"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "328d2b64-7bc6-425a-b3a4-8cda754ffd56"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:27 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Creating event network-vif-plugged:2a2ef05a-2d58-4cdf-ab6c-35df823a68bc for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:27 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Creating event network-vif-plugged:7f7db929-b2fd-4242-9d23-5d58a374f961 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:27 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Creating event network-vif-plugged:7f7db929-b2fd-4242-9d23-5d58a374f961 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:27 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Creating event network-vif-plugged:328d2b64-7bc6-425a-b3a4-8cda754ffd56 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:27 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Creating event network-vif-plugged:328d2b64-7bc6-425a-b3a4-8cda754ffd56 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:27 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.042108 Apr 14 10:44:27 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 52/148] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:27 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:44:28 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "23214923-0217-4046-9a68-675f2ee8e42d"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "4d65e4a1-4cea-4636-8ad8-21065de3c747"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "4d65e4a1-4cea-4636-8ad8-21065de3c747"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "6e295a29-0297-49c0-9298-7d3a41a07585"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "6e295a29-0297-49c0-9298-7d3a41a07585"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:28 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:28 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:28 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:28 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Creating event network-vif-plugged:23214923-0217-4046-9a68-675f2ee8e42d for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:28 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Creating event network-vif-plugged:4d65e4a1-4cea-4636-8ad8-21065de3c747 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:28 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Creating event network-vif-plugged:4d65e4a1-4cea-4636-8ad8-21065de3c747 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:28 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Creating event network-vif-plugged:d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:28 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Creating event network-vif-plugged:d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:28 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Creating event network-vif-plugged:6e295a29-0297-49c0-9298-7d3a41a07585 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:28 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Creating event network-vif-plugged:6e295a29-0297-49c0-9298-7d3a41a07585 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:44:28 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.055274 Apr 14 10:44:28 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 49/149] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 10:44:28 2023] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:44:30 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-2b24b1d6-d143-4b44-84d2-b6220feffa10 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:30 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-2b24b1d6-d143-4b44-84d2-b6220feffa10 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2b24b1d6-d143-4b44-84d2-b6220feffa10 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2b24b1d6-d143-4b44-84d2-b6220feffa10 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2b24b1d6-d143-4b44-84d2-b6220feffa10 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2b24b1d6-d143-4b44-84d2-b6220feffa10 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2b24b1d6-d143-4b44-84d2-b6220feffa10 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2b24b1d6-d143-4b44-84d2-b6220feffa10 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:30 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-2b24b1d6-d143-4b44-84d2-b6220feffa10 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187b7b3152ef496cbd84a94232d5ada5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78792d5e25ef4c7aa31b0656dacdd9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:30 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-2b24b1d6-d143-4b44-84d2-b6220feffa10 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0e2af6d-3694-4166-a3d0-b5be1107c488" status: 200 len: 1454 microversion: 2.1 time: 0.220520 Apr 14 10:44:30 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 49/150] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:44:30 2023] GET /compute/v2.1/servers/c0e2af6d-3694-4166-a3d0-b5be1107c488 => generated 1454 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:44:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1908b59-2946-48a2-b435-29a931e13ce3"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:32 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:32 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=21 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:33 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.415443 Apr 14 10:44:33 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 53/151] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:44:32 2023] POST /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/os-volume_attachments => generated 194 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:33 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:33 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:33 user devstack@n-api.service[61839]: DEBUG nova.objects.instance [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'flavor' on Instance uuid 97820f17-22d1-4ec3-9721-1edadccc794a {{(pid=61839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:44:33 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "POST /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a/action" status: 200 len: 32 microversion: 2.1 time: 0.437789 Apr 14 10:44:33 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 50/152] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:44:33 2023] POST /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a/action => generated 32 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:44:33 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-c41e3b23-4408-4ca7-9879-0199e7466d0b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:33 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-c41e3b23-4408-4ca7-9879-0199e7466d0b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c41e3b23-4408-4ca7-9879-0199e7466d0b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c41e3b23-4408-4ca7-9879-0199e7466d0b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c41e3b23-4408-4ca7-9879-0199e7466d0b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c41e3b23-4408-4ca7-9879-0199e7466d0b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c41e3b23-4408-4ca7-9879-0199e7466d0b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c41e3b23-4408-4ca7-9879-0199e7466d0b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:33 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-c41e3b23-4408-4ca7-9879-0199e7466d0b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-c41e3b23-4408-4ca7-9879-0199e7466d0b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a" status: 200 len: 1508 microversion: 2.1 time: 0.239809 Apr 14 10:44:34 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 50/153] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:44:33 2023] GET /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:44:35 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-fa695b1f-ee75-4a77-8f8b-2b597cb48949 req-2d23954e-d6db-4705-bc30-38628f8213e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97820f17-22d1-4ec3-9721-1edadccc794a", "name": "network-vif-unplugged", "status": "completed", "tag": "dea3830d-9f49-4d5e-953b-eec2ee969b02"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-fa695b1f-ee75-4a77-8f8b-2b597cb48949 req-2d23954e-d6db-4705-bc30-38628f8213e6 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-fa695b1f-ee75-4a77-8f8b-2b597cb48949 req-2d23954e-d6db-4705-bc30-38628f8213e6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-fa695b1f-ee75-4a77-8f8b-2b597cb48949 req-2d23954e-d6db-4705-bc30-38628f8213e6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:35 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-fa695b1f-ee75-4a77-8f8b-2b597cb48949 req-2d23954e-d6db-4705-bc30-38628f8213e6 service nova] Creating event network-vif-unplugged:dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance 97820f17-22d1-4ec3-9721-1edadccc794a on user Apr 14 10:44:35 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-fa695b1f-ee75-4a77-8f8b-2b597cb48949 req-2d23954e-d6db-4705-bc30-38628f8213e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062912 Apr 14 10:44:35 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 54/154] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:35 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-dc2c699d-2f6e-4bce-ba71-962403fdc86f tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:35 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-dc2c699d-2f6e-4bce-ba71-962403fdc86f tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dc2c699d-2f6e-4bce-ba71-962403fdc86f tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dc2c699d-2f6e-4bce-ba71-962403fdc86f tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dc2c699d-2f6e-4bce-ba71-962403fdc86f tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dc2c699d-2f6e-4bce-ba71-962403fdc86f tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dc2c699d-2f6e-4bce-ba71-962403fdc86f tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dc2c699d-2f6e-4bce-ba71-962403fdc86f tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:36 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-dc2c699d-2f6e-4bce-ba71-962403fdc86f tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c4ab86a8d244c4be5889b4ac47561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e1e1695464eb5ad8a8c881cf24611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:36 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-dc2c699d-2f6e-4bce-ba71-962403fdc86f tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606" status: 200 len: 1432 microversion: 2.1 time: 0.291639 Apr 14 10:44:36 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 51/155] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:44:35 2023] GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606 => generated 1432 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:44:37 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-b4ea330f-78e6-4067-a9ac-32e08a5f5e48 req-82fe4bda-c0f5-467a-837f-d78f90544e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97820f17-22d1-4ec3-9721-1edadccc794a", "name": "network-vif-plugged", "status": "completed", "tag": "dea3830d-9f49-4d5e-953b-eec2ee969b02"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:37 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b4ea330f-78e6-4067-a9ac-32e08a5f5e48 req-82fe4bda-c0f5-467a-837f-d78f90544e09 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:37 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b4ea330f-78e6-4067-a9ac-32e08a5f5e48 req-82fe4bda-c0f5-467a-837f-d78f90544e09 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:37 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b4ea330f-78e6-4067-a9ac-32e08a5f5e48 req-82fe4bda-c0f5-467a-837f-d78f90544e09 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:37 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-b4ea330f-78e6-4067-a9ac-32e08a5f5e48 req-82fe4bda-c0f5-467a-837f-d78f90544e09 service nova] Creating event network-vif-plugged:dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance 97820f17-22d1-4ec3-9721-1edadccc794a on user Apr 14 10:44:37 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-b4ea330f-78e6-4067-a9ac-32e08a5f5e48 req-82fe4bda-c0f5-467a-837f-d78f90544e09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051747 Apr 14 10:44:37 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 51/156] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:44:39 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97820f17-22d1-4ec3-9721-1edadccc794a", "name": "network-vif-plugged", "status": "completed", "tag": "dea3830d-9f49-4d5e-953b-eec2ee969b02"}, {"server_uuid": "97820f17-22d1-4ec3-9721-1edadccc794a", "name": "network-vif-plugged", "status": "completed", "tag": "dea3830d-9f49-4d5e-953b-eec2ee969b02"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:39 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] Creating event network-vif-plugged:dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance 97820f17-22d1-4ec3-9721-1edadccc794a on user Apr 14 10:44:39 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] Creating event network-vif-plugged:dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance 97820f17-22d1-4ec3-9721-1edadccc794a on user Apr 14 10:44:39 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030185 Apr 14 10:44:39 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 55/157] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:40 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-7577296c-56a8-44c2-b477-665c786442e4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:40 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-7577296c-56a8-44c2-b477-665c786442e4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7577296c-56a8-44c2-b477-665c786442e4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7577296c-56a8-44c2-b477-665c786442e4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7577296c-56a8-44c2-b477-665c786442e4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7577296c-56a8-44c2-b477-665c786442e4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7577296c-56a8-44c2-b477-665c786442e4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7577296c-56a8-44c2-b477-665c786442e4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-451a16ce-a433-495f-affe-b3f8ae89ca72 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:40 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-451a16ce-a433-495f-affe-b3f8ae89ca72 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-451a16ce-a433-495f-affe-b3f8ae89ca72 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-451a16ce-a433-495f-affe-b3f8ae89ca72 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-451a16ce-a433-495f-affe-b3f8ae89ca72 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-451a16ce-a433-495f-affe-b3f8ae89ca72 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-451a16ce-a433-495f-affe-b3f8ae89ca72 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-451a16ce-a433-495f-affe-b3f8ae89ca72 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:41 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-7577296c-56a8-44c2-b477-665c786442e4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.136384 Apr 14 10:44:41 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 52/158] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 10:44:40 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/os-interface => generated 282 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:41 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-451a16ce-a433-495f-affe-b3f8ae89ca72 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3579ac20f8094f5a9fbd036ed05cda23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f701119cef78433280cbddf2adf685db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:41 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-451a16ce-a433-495f-affe-b3f8ae89ca72 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3579ac20f8094f5a9fbd036ed05cda23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f701119cef78433280cbddf2adf685db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:41 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-451a16ce-a433-495f-affe-b3f8ae89ca72 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3579ac20f8094f5a9fbd036ed05cda23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f701119cef78433280cbddf2adf685db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-451a16ce-a433-495f-affe-b3f8ae89ca72 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca" status: 200 len: 2823 microversion: 2.42 time: 0.344204 Apr 14 10:44:41 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 52/159] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:44:40 2023] GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca => generated 2823 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 10:44:42 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-1f62bed9-6d6c-4bbc-936e-fdc97c56e88b req-d64495bf-8470-43b9-bab7-cbd0024c7006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:42 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=14 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:44:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-1f62bed9-6d6c-4bbc-936e-fdc97c56e88b req-d64495bf-8470-43b9-bab7-cbd0024c7006 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-1f62bed9-6d6c-4bbc-936e-fdc97c56e88b req-d64495bf-8470-43b9-bab7-cbd0024c7006 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-1f62bed9-6d6c-4bbc-936e-fdc97c56e88b req-d64495bf-8470-43b9-bab7-cbd0024c7006 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:42 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-1f62bed9-6d6c-4bbc-936e-fdc97c56e88b req-d64495bf-8470-43b9-bab7-cbd0024c7006 service nova] Creating event network-changed:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:44:42 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-1f62bed9-6d6c-4bbc-936e-fdc97c56e88b req-d64495bf-8470-43b9-bab7-cbd0024c7006 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050571 Apr 14 10:44:42 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 56/160] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:42 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f131312a-8ec6-4e03-8000-c0d43695da41 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:42 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-f131312a-8ec6-4e03-8000-c0d43695da41 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:42 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f131312a-8ec6-4e03-8000-c0d43695da41 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:42 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f131312a-8ec6-4e03-8000-c0d43695da41 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:42 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f131312a-8ec6-4e03-8000-c0d43695da41 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:42 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f131312a-8ec6-4e03-8000-c0d43695da41 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:42 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f131312a-8ec6-4e03-8000-c0d43695da41 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:42 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f131312a-8ec6-4e03-8000-c0d43695da41 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:42 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-f131312a-8ec6-4e03-8000-c0d43695da41 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:42 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-f131312a-8ec6-4e03-8000-c0d43695da41 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1538 microversion: 2.1 time: 0.175781 Apr 14 10:44:42 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 53/161] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:44:42 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1538 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:44:42 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-522c0f4e-6ad3-453f-aa6d-7a82cda97880 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:42 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-522c0f4e-6ad3-453f-aa6d-7a82cda97880 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-522c0f4e-6ad3-453f-aa6d-7a82cda97880 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-522c0f4e-6ad3-453f-aa6d-7a82cda97880 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-522c0f4e-6ad3-453f-aa6d-7a82cda97880 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-522c0f4e-6ad3-453f-aa6d-7a82cda97880 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-522c0f4e-6ad3-453f-aa6d-7a82cda97880 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-522c0f4e-6ad3-453f-aa6d-7a82cda97880 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:43 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-522c0f4e-6ad3-453f-aa6d-7a82cda97880 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:43 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-522c0f4e-6ad3-453f-aa6d-7a82cda97880 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1538 microversion: 2.1 time: 0.527256 Apr 14 10:44:43 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 53/162] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:44:42 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1538 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:44:44 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:44 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:44 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:44:44 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a" status: 204 len: 0 microversion: 2.1 time: 0.309904 Apr 14 10:44:44 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 57/163] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:44:44 2023] DELETE /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:44:44 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-379fb54e-6137-458f-811c-7336f77cf380 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:44 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-379fb54e-6137-458f-811c-7336f77cf380 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-379fb54e-6137-458f-811c-7336f77cf380 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-379fb54e-6137-458f-811c-7336f77cf380 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-379fb54e-6137-458f-811c-7336f77cf380 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-379fb54e-6137-458f-811c-7336f77cf380 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-379fb54e-6137-458f-811c-7336f77cf380 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-379fb54e-6137-458f-811c-7336f77cf380 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:44 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-379fb54e-6137-458f-811c-7336f77cf380 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9842a4c91c4d45b52da0b404fc27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30856983340a435d8e92f138fdecaa35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:44 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-379fb54e-6137-458f-811c-7336f77cf380 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a" status: 200 len: 1543 microversion: 2.1 time: 0.201946 Apr 14 10:44:44 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 54/164] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:44:44 2023] GET /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a => generated 1543 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:44:44 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-d4b6debf-f6db-4706-850d-e54ea8c8feee req-6207efef-7cdf-4538-990c-b37793abeda5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90a9b99-0985-403b-b4d8-eaa8c2eed88a", "name": "network-vif-unplugged", "status": "completed", "tag": "5bd8d359-958a-4b76-ac87-156c2a2adf35"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-d4b6debf-f6db-4706-850d-e54ea8c8feee req-6207efef-7cdf-4538-990c-b37793abeda5 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-d4b6debf-f6db-4706-850d-e54ea8c8feee req-6207efef-7cdf-4538-990c-b37793abeda5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-d4b6debf-f6db-4706-850d-e54ea8c8feee req-6207efef-7cdf-4538-990c-b37793abeda5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-d4b6debf-f6db-4706-850d-e54ea8c8feee req-6207efef-7cdf-4538-990c-b37793abeda5 service nova] Creating event network-vif-unplugged:5bd8d359-958a-4b76-ac87-156c2a2adf35 for instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a on user Apr 14 10:44:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-d4b6debf-f6db-4706-850d-e54ea8c8feee req-6207efef-7cdf-4538-990c-b37793abeda5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039721 Apr 14 10:44:44 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 54/165] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:45 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-d9ca93be-679a-4035-8d89-af7cb4ddaef5 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:45 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-d9ca93be-679a-4035-8d89-af7cb4ddaef5 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d9ca93be-679a-4035-8d89-af7cb4ddaef5 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d9ca93be-679a-4035-8d89-af7cb4ddaef5 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d9ca93be-679a-4035-8d89-af7cb4ddaef5 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d9ca93be-679a-4035-8d89-af7cb4ddaef5 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d9ca93be-679a-4035-8d89-af7cb4ddaef5 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d9ca93be-679a-4035-8d89-af7cb4ddaef5 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:45 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-d9ca93be-679a-4035-8d89-af7cb4ddaef5 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6dac34303f4965babaee39bb363b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e024f5a578e4543a02c6adc7d456f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:45 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-d9ca93be-679a-4035-8d89-af7cb4ddaef5 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f6dac34303f4965babaee39bb363b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e024f5a578e4543a02c6adc7d456f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:45 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-d9ca93be-679a-4035-8d89-af7cb4ddaef5 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f6dac34303f4965babaee39bb363b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e024f5a578e4543a02c6adc7d456f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:45 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-d9ca93be-679a-4035-8d89-af7cb4ddaef5 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e" status: 200 len: 2823 microversion: 2.32 time: 0.257533 Apr 14 10:44:45 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 58/166] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:44:45 2023] GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e => generated 2823 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:44:46 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-536a7b5d-c708-4ab5-a929-9bf36ffcea03 req-5857af07-9368-42f9-b213-03b09eeb8e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c90a9b99-0985-403b-b4d8-eaa8c2eed88a", "name": "network-vif-plugged", "status": "completed", "tag": "5bd8d359-958a-4b76-ac87-156c2a2adf35"}, {"server_uuid": "c90a9b99-0985-403b-b4d8-eaa8c2eed88a", "name": "network-vif-deleted", "tag": "5bd8d359-958a-4b76-ac87-156c2a2adf35"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-536a7b5d-c708-4ab5-a929-9bf36ffcea03 req-5857af07-9368-42f9-b213-03b09eeb8e2d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-536a7b5d-c708-4ab5-a929-9bf36ffcea03 req-5857af07-9368-42f9-b213-03b09eeb8e2d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-536a7b5d-c708-4ab5-a929-9bf36ffcea03 req-5857af07-9368-42f9-b213-03b09eeb8e2d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-536a7b5d-c708-4ab5-a929-9bf36ffcea03 req-5857af07-9368-42f9-b213-03b09eeb8e2d service nova] Creating event network-vif-plugged:5bd8d359-958a-4b76-ac87-156c2a2adf35 for instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a on user Apr 14 10:44:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-536a7b5d-c708-4ab5-a929-9bf36ffcea03 req-5857af07-9368-42f9-b213-03b09eeb8e2d service nova] Creating event network-vif-deleted:5bd8d359-958a-4b76-ac87-156c2a2adf35 for instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a on user Apr 14 10:44:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-536a7b5d-c708-4ab5-a929-9bf36ffcea03 req-5857af07-9368-42f9-b213-03b09eeb8e2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029797 Apr 14 10:44:46 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 55/167] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:47 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-bfe486bd-efc1-4db5-a9ca-551aa3efac36 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:47 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-bfe486bd-efc1-4db5-a9ca-551aa3efac36 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-bfe486bd-efc1-4db5-a9ca-551aa3efac36 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-bfe486bd-efc1-4db5-a9ca-551aa3efac36 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-bfe486bd-efc1-4db5-a9ca-551aa3efac36 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-bfe486bd-efc1-4db5-a9ca-551aa3efac36 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-bfe486bd-efc1-4db5-a9ca-551aa3efac36 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-bfe486bd-efc1-4db5-a9ca-551aa3efac36 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:47 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-bfe486bd-efc1-4db5-a9ca-551aa3efac36 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.166304 Apr 14 10:44:47 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 55/168] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 10:44:47 2023] GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/os-interface => generated 283 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:48 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-e14a24d4-04fd-4cea-a4c7-7842c32f081b req-5caf8b53-1d5f-44bb-af3f-21a73b380d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e14a24d4-04fd-4cea-a4c7-7842c32f081b req-5caf8b53-1d5f-44bb-af3f-21a73b380d6b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e14a24d4-04fd-4cea-a4c7-7842c32f081b req-5caf8b53-1d5f-44bb-af3f-21a73b380d6b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e14a24d4-04fd-4cea-a4c7-7842c32f081b req-5caf8b53-1d5f-44bb-af3f-21a73b380d6b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:48 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-e14a24d4-04fd-4cea-a4c7-7842c32f081b req-5caf8b53-1d5f-44bb-af3f-21a73b380d6b service nova] Creating event network-changed:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:44:48 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-e14a24d4-04fd-4cea-a4c7-7842c32f081b req-5caf8b53-1d5f-44bb-af3f-21a73b380d6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030883 Apr 14 10:44:48 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 59/169] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:44:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:44:48 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-414793843"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:44:48 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:49 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/action" status: 202 len: 0 microversion: 2.1 time: 0.802225 Apr 14 10:44:49 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 56/170] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:44:48 2023] POST /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/action => generated 0 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 10:44:49 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-3d21a992-c49a-48d8-81fd-7986e0ca4400 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '.version_select at 0x7fcd1d53bb50>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-3d21a992-c49a-48d8-81fd-7986e0ca4400 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "GET /compute/v2.1/images/aefc0dd9-6bb6-4a2f-ada9-e21b5f4d6151" status: 200 len: 1610 microversion: 2.1 time: 0.056892 Apr 14 10:44:49 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 56/171] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 10:44:49 2023] GET /compute/v2.1/images/aefc0dd9-6bb6-4a2f-ada9-e21b5f4d6151 => generated 1610 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:44:53 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e79cf9a6-64c8-4bda-a12f-cf6246cad99c tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:44:53 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-e79cf9a6-64c8-4bda-a12f-cf6246cad99c tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:44:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e79cf9a6-64c8-4bda-a12f-cf6246cad99c tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e79cf9a6-64c8-4bda-a12f-cf6246cad99c tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e79cf9a6-64c8-4bda-a12f-cf6246cad99c tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e79cf9a6-64c8-4bda-a12f-cf6246cad99c tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:44:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e79cf9a6-64c8-4bda-a12f-cf6246cad99c tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:44:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e79cf9a6-64c8-4bda-a12f-cf6246cad99c tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:44:53 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-e79cf9a6-64c8-4bda-a12f-cf6246cad99c tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ed4663d8984fe7b5d95616281bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1696bf804b2e4d7f86162513015c8e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:44:53 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-e79cf9a6-64c8-4bda-a12f-cf6246cad99c tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c" status: 200 len: 1567 microversion: 2.1 time: 0.203169 Apr 14 10:44:53 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 60/172] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:44:53 2023] GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:45:04 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=20 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:45:04 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:45:04 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-b126bf2d-c5f6-49be-9743-f7e5f55f6551 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:04 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-b126bf2d-c5f6-49be-9743-f7e5f55f6551 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b126bf2d-c5f6-49be-9743-f7e5f55f6551 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b126bf2d-c5f6-49be-9743-f7e5f55f6551 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b126bf2d-c5f6-49be-9743-f7e5f55f6551 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b126bf2d-c5f6-49be-9743-f7e5f55f6551 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b126bf2d-c5f6-49be-9743-f7e5f55f6551 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b126bf2d-c5f6-49be-9743-f7e5f55f6551 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:05 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-b126bf2d-c5f6-49be-9743-f7e5f55f6551 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.091591 Apr 14 10:45:05 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 57/173] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 10:45:04 2023] GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d/os-interface => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:06 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=18 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:45:06 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=36 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:45:06 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-d45050eb-5b0e-4cf1-9287-aab56677d256 req-4b8fb57a-0805-4d14-bb7f-12c4f5276466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec16b4bc-5385-4eea-856f-710d52d0261d", "tag": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-d45050eb-5b0e-4cf1-9287-aab56677d256 req-4b8fb57a-0805-4d14-bb7f-12c4f5276466 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-d45050eb-5b0e-4cf1-9287-aab56677d256 req-4b8fb57a-0805-4d14-bb7f-12c4f5276466 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-d45050eb-5b0e-4cf1-9287-aab56677d256 req-4b8fb57a-0805-4d14-bb7f-12c4f5276466 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:06 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-d45050eb-5b0e-4cf1-9287-aab56677d256 req-4b8fb57a-0805-4d14-bb7f-12c4f5276466 service nova] Creating event network-changed:2ee28d01-fbb2-4cf6-adcd-342fdabc8458 for instance ec16b4bc-5385-4eea-856f-710d52d0261d on user Apr 14 10:45:06 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-d45050eb-5b0e-4cf1-9287-aab56677d256 req-4b8fb57a-0805-4d14-bb7f-12c4f5276466 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053775 Apr 14 10:45:06 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 57/174] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:09 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc06bb14-764f-4a9f-ac7d-577f85f2bdb2"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:09 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:09 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:45:09 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:45:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:09 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315507 Apr 14 10:45:09 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 61/175] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:45:09 2023] POST /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:12 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-5f748d7d-813e-444b-a650-6392963b4419 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:12 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-5f748d7d-813e-444b-a650-6392963b4419 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5f748d7d-813e-444b-a650-6392963b4419 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5f748d7d-813e-444b-a650-6392963b4419 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5f748d7d-813e-444b-a650-6392963b4419 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5f748d7d-813e-444b-a650-6392963b4419 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5f748d7d-813e-444b-a650-6392963b4419 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5f748d7d-813e-444b-a650-6392963b4419 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:12 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-5f748d7d-813e-444b-a650-6392963b4419 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.092995 Apr 14 10:45:12 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 58/176] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 10:45:12 2023] GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-interface => generated 282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:12 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-7d2a61e5-b9fa-4ee9-9c8f-827a09a4acc3 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:12 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-7d2a61e5-b9fa-4ee9-9c8f-827a09a4acc3 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7d2a61e5-b9fa-4ee9-9c8f-827a09a4acc3 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7d2a61e5-b9fa-4ee9-9c8f-827a09a4acc3 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7d2a61e5-b9fa-4ee9-9c8f-827a09a4acc3 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7d2a61e5-b9fa-4ee9-9c8f-827a09a4acc3 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7d2a61e5-b9fa-4ee9-9c8f-827a09a4acc3 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7d2a61e5-b9fa-4ee9-9c8f-827a09a4acc3 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:12 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-7d2a61e5-b9fa-4ee9-9c8f-827a09a4acc3 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.104496 Apr 14 10:45:12 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 58/177] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 10:45:12 2023] GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-interface => generated 282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:45:13 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-4ef603b9-49b6-4cf9-acc0-f9ea4622d396 req-66206826-591f-4a86-90d9-eb5023b4e665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f539d8-4144-467b-ac69-44011c5b3564", "tag": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-4ef603b9-49b6-4cf9-acc0-f9ea4622d396 req-66206826-591f-4a86-90d9-eb5023b4e665 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-4ef603b9-49b6-4cf9-acc0-f9ea4622d396 req-66206826-591f-4a86-90d9-eb5023b4e665 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-4ef603b9-49b6-4cf9-acc0-f9ea4622d396 req-66206826-591f-4a86-90d9-eb5023b4e665 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:13 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-4ef603b9-49b6-4cf9-acc0-f9ea4622d396 req-66206826-591f-4a86-90d9-eb5023b4e665 service nova] Creating event network-changed:d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 for instance d6f539d8-4144-467b-ac69-44011c5b3564 on user Apr 14 10:45:13 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-4ef603b9-49b6-4cf9-acc0-f9ea4622d396 req-66206826-591f-4a86-90d9-eb5023b4e665 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029491 Apr 14 10:45:13 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 62/178] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:45:13 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cfc127d-dadf-4588-9781-c90f1906df63"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:13 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:13 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305084 Apr 14 10:45:13 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 59/179] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:45:13 2023] POST /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:13 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-7802afa0-c291-4d59-bc50-7903e4b7580c req-b0462579-ddf6-41c3-891b-43bbd51c7400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31f6ad8c-40d3-4b6e-af07-4848fafc431d", "tag": "edef0af3-01e9-4008-9017-119519f73981"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-7802afa0-c291-4d59-bc50-7903e4b7580c req-b0462579-ddf6-41c3-891b-43bbd51c7400 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-7802afa0-c291-4d59-bc50-7903e4b7580c req-b0462579-ddf6-41c3-891b-43bbd51c7400 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-7802afa0-c291-4d59-bc50-7903e4b7580c req-b0462579-ddf6-41c3-891b-43bbd51c7400 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:13 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-7802afa0-c291-4d59-bc50-7903e4b7580c req-b0462579-ddf6-41c3-891b-43bbd51c7400 service nova] Creating event network-changed:edef0af3-01e9-4008-9017-119519f73981 for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d on user Apr 14 10:45:13 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-7802afa0-c291-4d59-bc50-7903e4b7580c req-b0462579-ddf6-41c3-891b-43bbd51c7400 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044253 Apr 14 10:45:13 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 59/180] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:13 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-ccf23262-97d0-4144-93a7-5bdcff5f73d4 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:13 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-ccf23262-97d0-4144-93a7-5bdcff5f73d4 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ccf23262-97d0-4144-93a7-5bdcff5f73d4 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ccf23262-97d0-4144-93a7-5bdcff5f73d4 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ccf23262-97d0-4144-93a7-5bdcff5f73d4 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ccf23262-97d0-4144-93a7-5bdcff5f73d4 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ccf23262-97d0-4144-93a7-5bdcff5f73d4 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ccf23262-97d0-4144-93a7-5bdcff5f73d4 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:13 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-ccf23262-97d0-4144-93a7-5bdcff5f73d4 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce31180e5946d4a027ae6ac9d136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8cdf0a5d7f49a9897167eb79dbfc39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:13 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-ccf23262-97d0-4144-93a7-5bdcff5f73d4 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ce31180e5946d4a027ae6ac9d136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8cdf0a5d7f49a9897167eb79dbfc39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:13 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-ccf23262-97d0-4144-93a7-5bdcff5f73d4 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ce31180e5946d4a027ae6ac9d136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8cdf0a5d7f49a9897167eb79dbfc39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:14 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-ccf23262-97d0-4144-93a7-5bdcff5f73d4 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d" status: 200 len: 1627 microversion: 2.49 time: 0.179590 Apr 14 10:45:14 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 63/181] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:45:13 2023] GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d => generated 1627 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:45:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "dee46276-cd75-40ca-87ae-c98f51de17c9", "tag": "nic-tag"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:14 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:16 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-ccef31de-9024-4062-98a8-649b65639a58 req-b67e90f7-4ec2-4f7c-a940-6c954e16fb8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31f6ad8c-40d3-4b6e-af07-4848fafc431d", "tag": "80f4161b-5489-4982-b3be-238ea838561a"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ccef31de-9024-4062-98a8-649b65639a58 req-b67e90f7-4ec2-4f7c-a940-6c954e16fb8c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ccef31de-9024-4062-98a8-649b65639a58 req-b67e90f7-4ec2-4f7c-a940-6c954e16fb8c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ccef31de-9024-4062-98a8-649b65639a58 req-b67e90f7-4ec2-4f7c-a940-6c954e16fb8c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-ccef31de-9024-4062-98a8-649b65639a58 req-b67e90f7-4ec2-4f7c-a940-6c954e16fb8c service nova] Creating event network-changed:80f4161b-5489-4982-b3be-238ea838561a for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d on user Apr 14 10:45:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-ccef31de-9024-4062-98a8-649b65639a58 req-b67e90f7-4ec2-4f7c-a940-6c954e16fb8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028681 Apr 14 10:45:16 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 60/182] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e4eed5d3-2466-45bd-8dcd-46935d274a45 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-e4eed5d3-2466-45bd-8dcd-46935d274a45 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e4eed5d3-2466-45bd-8dcd-46935d274a45 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e4eed5d3-2466-45bd-8dcd-46935d274a45 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e4eed5d3-2466-45bd-8dcd-46935d274a45 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e4eed5d3-2466-45bd-8dcd-46935d274a45 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e4eed5d3-2466-45bd-8dcd-46935d274a45 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e4eed5d3-2466-45bd-8dcd-46935d274a45 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:17 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-e4eed5d3-2466-45bd-8dcd-46935d274a45 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059047 Apr 14 10:45:17 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 64/183] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:45:17 2023] GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:17 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:17 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:17 user devstack@n-api.service[61840]: DEBUG nova.objects.instance [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lazy-loading 'services' on Instance uuid ec16b4bc-5385-4eea-856f-710d52d0261d {{(pid=61840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:45:17 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:17 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d/os-volume_attachments/dc06bb14-764f-4a9f-ac7d-577f85f2bdb2" status: 202 len: 0 microversion: 2.1 time: 0.347712 Apr 14 10:45:17 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 61/184] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:45:17 2023] DELETE /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d/os-volume_attachments/dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:45:17 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "POST /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-interface" status: 200 len: 281 microversion: 2.49 time: 3.500728 Apr 14 10:45:17 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 60/185] 10.0.0.210 () {66 vars in 1414 bytes} [Fri Apr 14 10:45:14 2023] POST /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-interface => generated 281 bytes in 3503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "207caef0-4168-4698-be0c-09ae18f2102d", "tag": "volume-tag"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:17 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "POST /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.319069 Apr 14 10:45:17 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 65/186] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 10:45:17 2023] POST /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:45:18 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f6ad8c-40d3-4b6e-af07-4848fafc431d", "name": "network-vif-plugged", "status": "completed", "tag": "80f4161b-5489-4982-b3be-238ea838561a"}, {"server_uuid": "31f6ad8c-40d3-4b6e-af07-4848fafc431d", "name": "network-vif-plugged", "status": "completed", "tag": "80f4161b-5489-4982-b3be-238ea838561a"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] Creating event network-vif-plugged:80f4161b-5489-4982-b3be-238ea838561a for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d on user Apr 14 10:45:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] Creating event network-vif-plugged:80f4161b-5489-4982-b3be-238ea838561a for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d on user Apr 14 10:45:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038380 Apr 14 10:45:18 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 62/187] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:19 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-6234e856-dfcd-4ca5-b9eb-404fcd43427a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:19 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-6234e856-dfcd-4ca5-b9eb-404fcd43427a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6234e856-dfcd-4ca5-b9eb-404fcd43427a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6234e856-dfcd-4ca5-b9eb-404fcd43427a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6234e856-dfcd-4ca5-b9eb-404fcd43427a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6234e856-dfcd-4ca5-b9eb-404fcd43427a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6234e856-dfcd-4ca5-b9eb-404fcd43427a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6234e856-dfcd-4ca5-b9eb-404fcd43427a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:19 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-6234e856-dfcd-4ca5-b9eb-404fcd43427a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041696 Apr 14 10:45:19 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 61/188] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:45:19 2023] GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:45:19 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-2a926d91-9677-4abc-a718-333bba304b9a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:19 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-2a926d91-9677-4abc-a718-333bba304b9a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2a926d91-9677-4abc-a718-333bba304b9a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2a926d91-9677-4abc-a718-333bba304b9a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2a926d91-9677-4abc-a718-333bba304b9a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2a926d91-9677-4abc-a718-333bba304b9a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2a926d91-9677-4abc-a718-333bba304b9a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2a926d91-9677-4abc-a718-333bba304b9a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:19 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-2a926d91-9677-4abc-a718-333bba304b9a tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055950 Apr 14 10:45:19 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 66/189] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:45:19 2023] GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:45:19 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:19 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:20 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Going to try to terminate instance {{(pid=61840) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:45:20 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d" status: 204 len: 0 microversion: 2.1 time: 0.178154 Apr 14 10:45:20 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 63/190] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:45:19 2023] DELETE /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:45:20 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-5915dfa4-af30-4507-9c30-ae8c664e1c03 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:20 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-5915dfa4-af30-4507-9c30-ae8c664e1c03 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5915dfa4-af30-4507-9c30-ae8c664e1c03 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5915dfa4-af30-4507-9c30-ae8c664e1c03 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5915dfa4-af30-4507-9c30-ae8c664e1c03 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5915dfa4-af30-4507-9c30-ae8c664e1c03 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5915dfa4-af30-4507-9c30-ae8c664e1c03 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5915dfa4-af30-4507-9c30-ae8c664e1c03 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:20 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-5915dfa4-af30-4507-9c30-ae8c664e1c03 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806d72cf0d0f4de3a4b9f0466a8e094d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77068eae4fa9459fbe81026615d0c16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:20 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-5915dfa4-af30-4507-9c30-ae8c664e1c03 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d" status: 200 len: 1675 microversion: 2.1 time: 0.199142 Apr 14 10:45:20 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 62/191] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:45:20 2023] GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d => generated 1675 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:45:20 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-958eaf35-3ffc-4407-ad08-b1ae692816b7 req-c677a436-ba5a-4a59-8ac1-a41955870389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec16b4bc-5385-4eea-856f-710d52d0261d", "name": "network-vif-unplugged", "status": "completed", "tag": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-958eaf35-3ffc-4407-ad08-b1ae692816b7 req-c677a436-ba5a-4a59-8ac1-a41955870389 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-958eaf35-3ffc-4407-ad08-b1ae692816b7 req-c677a436-ba5a-4a59-8ac1-a41955870389 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-958eaf35-3ffc-4407-ad08-b1ae692816b7 req-c677a436-ba5a-4a59-8ac1-a41955870389 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:20 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-958eaf35-3ffc-4407-ad08-b1ae692816b7 req-c677a436-ba5a-4a59-8ac1-a41955870389 service nova] Creating event network-vif-unplugged:2ee28d01-fbb2-4cf6-adcd-342fdabc8458 for instance ec16b4bc-5385-4eea-856f-710d52d0261d on user Apr 14 10:45:20 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-958eaf35-3ffc-4407-ad08-b1ae692816b7 req-c677a436-ba5a-4a59-8ac1-a41955870389 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034249 Apr 14 10:45:20 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 67/192] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "87bf508a-fb5e-40aa-abb8-ca896d37d55f"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:21 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:21 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments/4cfc127d-dadf-4588-9781-c90f1906df63" status: 202 len: 0 microversion: 2.1 time: 0.704186 Apr 14 10:45:21 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 64/193] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 10:45:21 2023] PUT /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments/4cfc127d-dadf-4588-9781-c90f1906df63 => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:45:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-556fa0db-299c-43cb-af22-f503496c15e6 req-7b5ed49f-6264-43af-973b-b2227855fcbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec16b4bc-5385-4eea-856f-710d52d0261d", "name": "network-vif-plugged", "status": "completed", "tag": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458"}, {"server_uuid": "ec16b4bc-5385-4eea-856f-710d52d0261d", "name": "network-vif-deleted", "tag": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-556fa0db-299c-43cb-af22-f503496c15e6 req-7b5ed49f-6264-43af-973b-b2227855fcbe service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-556fa0db-299c-43cb-af22-f503496c15e6 req-7b5ed49f-6264-43af-973b-b2227855fcbe service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-556fa0db-299c-43cb-af22-f503496c15e6 req-7b5ed49f-6264-43af-973b-b2227855fcbe service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:22 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-556fa0db-299c-43cb-af22-f503496c15e6 req-7b5ed49f-6264-43af-973b-b2227855fcbe service nova] Creating event network-vif-plugged:2ee28d01-fbb2-4cf6-adcd-342fdabc8458 for instance ec16b4bc-5385-4eea-856f-710d52d0261d on user Apr 14 10:45:22 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-556fa0db-299c-43cb-af22-f503496c15e6 req-7b5ed49f-6264-43af-973b-b2227855fcbe service nova] Creating event network-vif-deleted:2ee28d01-fbb2-4cf6-adcd-342fdabc8458 for instance ec16b4bc-5385-4eea-856f-710d52d0261d on user Apr 14 10:45:22 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-556fa0db-299c-43cb-af22-f503496c15e6 req-7b5ed49f-6264-43af-973b-b2227855fcbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061337 Apr 14 10:45:22 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 63/194] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:24 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-ab35b298-47b3-4cf4-ae95-23f5fdf69a08 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:24 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-ab35b298-47b3-4cf4-ae95-23f5fdf69a08 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ab35b298-47b3-4cf4-ae95-23f5fdf69a08 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ab35b298-47b3-4cf4-ae95-23f5fdf69a08 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ab35b298-47b3-4cf4-ae95-23f5fdf69a08 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ab35b298-47b3-4cf4-ae95-23f5fdf69a08 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ab35b298-47b3-4cf4-ae95-23f5fdf69a08 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ab35b298-47b3-4cf4-ae95-23f5fdf69a08 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:24 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-ab35b298-47b3-4cf4-ae95-23f5fdf69a08 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:24 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-ab35b298-47b3-4cf4-ae95-23f5fdf69a08 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a" status: 200 len: 1488 microversion: 2.1 time: 0.205119 Apr 14 10:45:24 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 68/195] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:45:24 2023] GET /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a => generated 1488 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:45:25 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:25 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:25 user devstack@n-api.service[61840]: DEBUG nova.objects.instance [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lazy-loading 'services' on Instance uuid 31f6ad8c-40d3-4b6e-af07-4848fafc431d {{(pid=61840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:45:25 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-volume_attachments/207caef0-4168-4698-be0c-09ae18f2102d" status: 202 len: 0 microversion: 2.49 time: 0.181172 Apr 14 10:45:25 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 65/196] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 10:45:25 2023] DELETE /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-volume_attachments/207caef0-4168-4698-be0c-09ae18f2102d => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:45:28 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:28 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:28 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:28 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:28 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:28 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:28 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:28 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:28 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-interface/80f4161b-5489-4982-b3be-238ea838561a" status: 202 len: 0 microversion: 2.49 time: 0.099085 Apr 14 10:45:28 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 64/197] 10.0.0.210 () {64 vars in 1507 bytes} [Fri Apr 14 10:45:28 2023] DELETE /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-interface/80f4161b-5489-4982-b3be-238ea838561a => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:45:28 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9a983e87-4808-4b94-a23b-d5c0a20e4e49 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:28 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-9a983e87-4808-4b94-a23b-d5c0a20e4e49 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:28 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9a983e87-4808-4b94-a23b-d5c0a20e4e49 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:28 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9a983e87-4808-4b94-a23b-d5c0a20e4e49 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:28 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9a983e87-4808-4b94-a23b-d5c0a20e4e49 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:28 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9a983e87-4808-4b94-a23b-d5c0a20e4e49 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:28 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9a983e87-4808-4b94-a23b-d5c0a20e4e49 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:28 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9a983e87-4808-4b94-a23b-d5c0a20e4e49 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:28 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-9a983e87-4808-4b94-a23b-d5c0a20e4e49 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-instance-actions/req-2c6010cc-acf5-4276-98a6-acab32d6c4da" status: 200 len: 474 microversion: 2.49 time: 0.213755 Apr 14 10:45:28 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 69/198] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 10:45:28 2023] GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-instance-actions/req-2c6010cc-acf5-4276-98a6-acab32d6c4da => generated 474 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:45:28 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-6c93e765-b511-49b9-b3b8-1b6c14376697 req-3328fd1a-1084-4499-9206-9ea2fd67b47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f6ad8c-40d3-4b6e-af07-4848fafc431d", "name": "network-vif-unplugged", "status": "completed", "tag": "80f4161b-5489-4982-b3be-238ea838561a"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6c93e765-b511-49b9-b3b8-1b6c14376697 req-3328fd1a-1084-4499-9206-9ea2fd67b47c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6c93e765-b511-49b9-b3b8-1b6c14376697 req-3328fd1a-1084-4499-9206-9ea2fd67b47c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6c93e765-b511-49b9-b3b8-1b6c14376697 req-3328fd1a-1084-4499-9206-9ea2fd67b47c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:28 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-6c93e765-b511-49b9-b3b8-1b6c14376697 req-3328fd1a-1084-4499-9206-9ea2fd67b47c service nova] Creating event network-vif-unplugged:80f4161b-5489-4982-b3be-238ea838561a for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d on user Apr 14 10:45:28 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-6c93e765-b511-49b9-b3b8-1b6c14376697 req-3328fd1a-1084-4499-9206-9ea2fd67b47c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040862 Apr 14 10:45:28 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 66/199] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:30 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-9fa1fe0b-cb75-493b-a08d-dba811a971ed req-dd5424e0-522b-4664-a70a-102d10b5eac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f6ad8c-40d3-4b6e-af07-4848fafc431d", "name": "network-vif-plugged", "status": "completed", "tag": "80f4161b-5489-4982-b3be-238ea838561a"}, {"server_uuid": "31f6ad8c-40d3-4b6e-af07-4848fafc431d", "name": "network-vif-deleted", "tag": "80f4161b-5489-4982-b3be-238ea838561a"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:30 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9fa1fe0b-cb75-493b-a08d-dba811a971ed req-dd5424e0-522b-4664-a70a-102d10b5eac3 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:30 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9fa1fe0b-cb75-493b-a08d-dba811a971ed req-dd5424e0-522b-4664-a70a-102d10b5eac3 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:30 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9fa1fe0b-cb75-493b-a08d-dba811a971ed req-dd5424e0-522b-4664-a70a-102d10b5eac3 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:30 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:30 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:30 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-9fa1fe0b-cb75-493b-a08d-dba811a971ed req-dd5424e0-522b-4664-a70a-102d10b5eac3 service nova] Creating event network-vif-plugged:80f4161b-5489-4982-b3be-238ea838561a for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d on user Apr 14 10:45:30 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-9fa1fe0b-cb75-493b-a08d-dba811a971ed req-dd5424e0-522b-4664-a70a-102d10b5eac3 service nova] Creating event network-vif-deleted:80f4161b-5489-4982-b3be-238ea838561a for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d on user Apr 14 10:45:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:30 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-9fa1fe0b-cb75-493b-a08d-dba811a971ed req-dd5424e0-522b-4664-a70a-102d10b5eac3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045905 Apr 14 10:45:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:30 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 65/200] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:31 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:45:31 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c0e2af6d-3694-4166-a3d0-b5be1107c488" status: 204 len: 0 microversion: 2.1 time: 0.148729 Apr 14 10:45:31 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 70/201] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:45:30 2023] DELETE /compute/v2.1/servers/c0e2af6d-3694-4166-a3d0-b5be1107c488 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:45:31 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-e0bba70b-154b-4dfb-b03e-2c05650af564 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:31 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-e0bba70b-154b-4dfb-b03e-2c05650af564 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e0bba70b-154b-4dfb-b03e-2c05650af564 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e0bba70b-154b-4dfb-b03e-2c05650af564 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e0bba70b-154b-4dfb-b03e-2c05650af564 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e0bba70b-154b-4dfb-b03e-2c05650af564 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e0bba70b-154b-4dfb-b03e-2c05650af564 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e0bba70b-154b-4dfb-b03e-2c05650af564 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:31 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-e0bba70b-154b-4dfb-b03e-2c05650af564 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187b7b3152ef496cbd84a94232d5ada5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78792d5e25ef4c7aa31b0656dacdd9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:31 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-e0bba70b-154b-4dfb-b03e-2c05650af564 tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0e2af6d-3694-4166-a3d0-b5be1107c488" status: 200 len: 1460 microversion: 2.1 time: 0.343504 Apr 14 10:45:31 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 67/202] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:45:31 2023] GET /compute/v2.1/servers/c0e2af6d-3694-4166-a3d0-b5be1107c488 => generated 1460 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:45:31 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-8923be1e-4bf5-4030-8480-2f71797d9313 req-a47d3e28-18d7-40ee-a5c3-604ad0d43d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e2af6d-3694-4166-a3d0-b5be1107c488", "name": "network-vif-unplugged", "status": "completed", "tag": "ade20134-2589-42de-8b15-051228d8d647"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:31 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8923be1e-4bf5-4030-8480-2f71797d9313 req-a47d3e28-18d7-40ee-a5c3-604ad0d43d5a service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:31 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8923be1e-4bf5-4030-8480-2f71797d9313 req-a47d3e28-18d7-40ee-a5c3-604ad0d43d5a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:31 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8923be1e-4bf5-4030-8480-2f71797d9313 req-a47d3e28-18d7-40ee-a5c3-604ad0d43d5a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:31 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-8923be1e-4bf5-4030-8480-2f71797d9313 req-a47d3e28-18d7-40ee-a5c3-604ad0d43d5a service nova] Creating event network-vif-unplugged:ade20134-2589-42de-8b15-051228d8d647 for instance c0e2af6d-3694-4166-a3d0-b5be1107c488 on user Apr 14 10:45:31 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-8923be1e-4bf5-4030-8480-2f71797d9313 req-a47d3e28-18d7-40ee-a5c3-604ad0d43d5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045742 Apr 14 10:45:31 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 66/203] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-98753f69-f24c-4678-927e-df6df5036f49 req-5cccdbd9-9bf1-4fef-98fe-bbd19b5d40f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e2af6d-3694-4166-a3d0-b5be1107c488", "name": "network-vif-deleted", "tag": "ade20134-2589-42de-8b15-051228d8d647"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-98753f69-f24c-4678-927e-df6df5036f49 req-5cccdbd9-9bf1-4fef-98fe-bbd19b5d40f2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-98753f69-f24c-4678-927e-df6df5036f49 req-5cccdbd9-9bf1-4fef-98fe-bbd19b5d40f2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-98753f69-f24c-4678-927e-df6df5036f49 req-5cccdbd9-9bf1-4fef-98fe-bbd19b5d40f2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:33 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-98753f69-f24c-4678-927e-df6df5036f49 req-5cccdbd9-9bf1-4fef-98fe-bbd19b5d40f2 service nova] Creating event network-vif-deleted:ade20134-2589-42de-8b15-051228d8d647 for instance c0e2af6d-3694-4166-a3d0-b5be1107c488 on user Apr 14 10:45:33 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-98753f69-f24c-4678-927e-df6df5036f49 req-5cccdbd9-9bf1-4fef-98fe-bbd19b5d40f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036471 Apr 14 10:45:33 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 71/204] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:33 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-8ba97f7c-b4f9-4bbf-bea7-6462cd23e007 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:33 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-8ba97f7c-b4f9-4bbf-bea7-6462cd23e007 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8ba97f7c-b4f9-4bbf-bea7-6462cd23e007 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8ba97f7c-b4f9-4bbf-bea7-6462cd23e007 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8ba97f7c-b4f9-4bbf-bea7-6462cd23e007 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8ba97f7c-b4f9-4bbf-bea7-6462cd23e007 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8ba97f7c-b4f9-4bbf-bea7-6462cd23e007 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8ba97f7c-b4f9-4bbf-bea7-6462cd23e007 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:33 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-8ba97f7c-b4f9-4bbf-bea7-6462cd23e007 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:33 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-8ba97f7c-b4f9-4bbf-bea7-6462cd23e007 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1657 microversion: 2.1 time: 0.158266 Apr 14 10:45:33 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 68/205] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:45:33 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1657 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:45:33 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8387ce67-d63c-4ff1-99a3-39e58834c5de tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:33 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-8387ce67-d63c-4ff1-99a3-39e58834c5de tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8387ce67-d63c-4ff1-99a3-39e58834c5de tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8387ce67-d63c-4ff1-99a3-39e58834c5de tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8387ce67-d63c-4ff1-99a3-39e58834c5de tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8387ce67-d63c-4ff1-99a3-39e58834c5de tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8387ce67-d63c-4ff1-99a3-39e58834c5de tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8387ce67-d63c-4ff1-99a3-39e58834c5de tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:33 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-8387ce67-d63c-4ff1-99a3-39e58834c5de tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:33 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-8387ce67-d63c-4ff1-99a3-39e58834c5de tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1657 microversion: 2.1 time: 0.156853 Apr 14 10:45:33 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 67/206] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:45:33 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1657 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:45:33 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-9649fa20-8249-45d8-afc9-42a8356c8ed9 req-53fd509c-87f5-4b61-bcb5-be4a38b6d8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e2af6d-3694-4166-a3d0-b5be1107c488", "name": "network-vif-plugged", "status": "completed", "tag": "ade20134-2589-42de-8b15-051228d8d647"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-9649fa20-8249-45d8-afc9-42a8356c8ed9 req-53fd509c-87f5-4b61-bcb5-be4a38b6d8aa service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-9649fa20-8249-45d8-afc9-42a8356c8ed9 req-53fd509c-87f5-4b61-bcb5-be4a38b6d8aa service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-9649fa20-8249-45d8-afc9-42a8356c8ed9 req-53fd509c-87f5-4b61-bcb5-be4a38b6d8aa service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:33 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-9649fa20-8249-45d8-afc9-42a8356c8ed9 req-53fd509c-87f5-4b61-bcb5-be4a38b6d8aa service nova] Creating event network-vif-plugged:ade20134-2589-42de-8b15-051228d8d647 for instance c0e2af6d-3694-4166-a3d0-b5be1107c488 on user Apr 14 10:45:33 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-9649fa20-8249-45d8-afc9-42a8356c8ed9 req-53fd509c-87f5-4b61-bcb5-be4a38b6d8aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031462 Apr 14 10:45:33 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 72/207] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-c7fee81e-626b-4e39-bc5a-0cc8b75ef5d1 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-c7fee81e-626b-4e39-bc5a-0cc8b75ef5d1 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c7fee81e-626b-4e39-bc5a-0cc8b75ef5d1 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c7fee81e-626b-4e39-bc5a-0cc8b75ef5d1 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c7fee81e-626b-4e39-bc5a-0cc8b75ef5d1 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c7fee81e-626b-4e39-bc5a-0cc8b75ef5d1 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c7fee81e-626b-4e39-bc5a-0cc8b75ef5d1 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c7fee81e-626b-4e39-bc5a-0cc8b75ef5d1 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-c7fee81e-626b-4e39-bc5a-0cc8b75ef5d1 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] HTTP exception thrown: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-c7fee81e-626b-4e39-bc5a-0cc8b75ef5d1 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Request method failure captured: Apr 14 10:45:34 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a HTTP/1.1 Apr 14 10:45:34 user devstack@n-api.service[61840]: Accept: application/json Apr 14 10:45:34 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 10:45:34 user devstack@n-api.service[61840]: Connection: close Apr 14 10:45:34 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 10:45:34 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 10:45:34 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 10:45:34 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 10:45:34 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 10:45:34 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS4cvZe2WQdsZ8yN8qobpJhJh5ddT2oF5E4UibVRaJfgPnXdygUDM6q_5mb9rkR4kD6VS_tAx72REqtt3V1wwUF8E7EwzEEhUHskduq4ZHzNQ5IGMgNWRTsBpEwCWdG91qPf2yoO_ec7GBQekpcg_1zN4FzP0dBXWRRykxfJHq2d-oY Apr 14 10:45:34 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 10:45:34 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 10:45:34 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 10:45:34 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 10:45:34 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 10:45:34 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 10:45:34 user devstack@n-api.service[61840]: X-Project-Id: 30856983340a435d8e92f138fdecaa35 Apr 14 10:45:34 user devstack@n-api.service[61840]: X-Project-Name: tempest-DeleteServersTestJSON-1788928325 Apr 14 10:45:34 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 10:45:34 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 10:45:34 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/30856983340a435d8e92f138fdecaa35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/30856983340a435d8e92f138fdecaa35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/30856983340a435d8e92f138fdecaa35"}]}] Apr 14 10:45:34 user devstack@n-api.service[61840]: X-Tenant: tempest-DeleteServersTestJSON-1788928325 Apr 14 10:45:34 user devstack@n-api.service[61840]: X-Tenant-Id: 30856983340a435d8e92f138fdecaa35 Apr 14 10:45:34 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-DeleteServersTestJSON-1788928325 Apr 14 10:45:34 user devstack@n-api.service[61840]: X-User: tempest-DeleteServersTestJSON-1788928325-project-member Apr 14 10:45:34 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 10:45:34 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 10:45:34 user devstack@n-api.service[61840]: X-User-Id: 0a9842a4c91c4d45b52da0b404fc27c2 Apr 14 10:45:34 user devstack@n-api.service[61840]: X-User-Name: tempest-DeleteServersTestJSON-1788928325-project-member Apr 14 10:45:34 user devstack@n-api.service[61840]: method: > Apr 14 10:45:34 user devstack@n-api.service[61840]: exception: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:34 user devstack@n-api.service[61840]: action_args: {'id': 'c90a9b99-0985-403b-b4d8-eaa8c2eed88a'} Apr 14 10:45:34 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:34 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-c7fee81e-626b-4e39-bc5a-0cc8b75ef5d1 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Returning 404 to user: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:45:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-c7fee81e-626b-4e39-bc5a-0cc8b75ef5d1 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a" status: 404 len: 111 microversion: 2.1 time: 0.045439 Apr 14 10:45:34 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 69/208] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:45:34 2023] GET /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:45:34 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-25e13c68-93cd-4a52-ae3c-69a31e5651d9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:34 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-25e13c68-93cd-4a52-ae3c-69a31e5651d9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-25e13c68-93cd-4a52-ae3c-69a31e5651d9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-25e13c68-93cd-4a52-ae3c-69a31e5651d9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-25e13c68-93cd-4a52-ae3c-69a31e5651d9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-25e13c68-93cd-4a52-ae3c-69a31e5651d9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-25e13c68-93cd-4a52-ae3c-69a31e5651d9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-25e13c68-93cd-4a52-ae3c-69a31e5651d9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:34 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a7065558-cd2a-45b9-b69a-b6a3692a2a2b tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:34 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-a7065558-cd2a-45b9-b69a-b6a3692a2a2b tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a7065558-cd2a-45b9-b69a-b6a3692a2a2b tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a7065558-cd2a-45b9-b69a-b6a3692a2a2b tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a7065558-cd2a-45b9-b69a-b6a3692a2a2b tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a7065558-cd2a-45b9-b69a-b6a3692a2a2b tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a7065558-cd2a-45b9-b69a-b6a3692a2a2b tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a7065558-cd2a-45b9-b69a-b6a3692a2a2b tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:34 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-25e13c68-93cd-4a52-ae3c-69a31e5651d9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070988 Apr 14 10:45:34 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 68/209] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:45:34 2023] GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-23c3f228-883a-4913-8553-6ae59a1f8ad7 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:34 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-a7065558-cd2a-45b9-b69a-b6a3692a2a2b tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] HTTP exception thrown: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-23c3f228-883a-4913-8553-6ae59a1f8ad7 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:34 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a7065558-cd2a-45b9-b69a-b6a3692a2a2b tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Request method failure captured: Apr 14 10:45:34 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/os-volume_attachments HTTP/1.1 Apr 14 10:45:34 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:45:34 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:45:34 user devstack@n-api.service[61841]: Connection: close Apr 14 10:45:34 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 10:45:34 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:45:34 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:45:34 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:45:34 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:45:34 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4cvZe2WQdsZ8yN8qobpJhJh5ddT2oF5E4UibVRaJfgPnXdygUDM6q_5mb9rkR4kD6VS_tAx72REqtt3V1wwUF8E7EwzEEhUHskduq4ZHzNQ5IGMgNWRTsBpEwCWdG91qPf2yoO_ec7GBQekpcg_1zN4FzP0dBXWRRykxfJHq2d-oY Apr 14 10:45:34 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:45:34 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:45:34 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:45:34 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:45:34 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:45:34 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:45:34 user devstack@n-api.service[61841]: X-Project-Id: 30856983340a435d8e92f138fdecaa35 Apr 14 10:45:34 user devstack@n-api.service[61841]: X-Project-Name: tempest-DeleteServersTestJSON-1788928325 Apr 14 10:45:34 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:45:34 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:45:34 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/30856983340a435d8e92f138fdecaa35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/30856983340a435d8e92f138fdecaa35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/30856983340a435d8e92f138fdecaa35"}]}] Apr 14 10:45:34 user devstack@n-api.service[61841]: X-Tenant: tempest-DeleteServersTestJSON-1788928325 Apr 14 10:45:34 user devstack@n-api.service[61841]: X-Tenant-Id: 30856983340a435d8e92f138fdecaa35 Apr 14 10:45:34 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-DeleteServersTestJSON-1788928325 Apr 14 10:45:34 user devstack@n-api.service[61841]: X-User: tempest-DeleteServersTestJSON-1788928325-project-member Apr 14 10:45:34 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:45:34 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:45:34 user devstack@n-api.service[61841]: X-User-Id: 0a9842a4c91c4d45b52da0b404fc27c2 Apr 14 10:45:34 user devstack@n-api.service[61841]: X-User-Name: tempest-DeleteServersTestJSON-1788928325-project-member Apr 14 10:45:34 user devstack@n-api.service[61841]: method: > Apr 14 10:45:34 user devstack@n-api.service[61841]: exception: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:34 user devstack@n-api.service[61841]: action_args: {'server_id': 'c90a9b99-0985-403b-b4d8-eaa8c2eed88a'} Apr 14 10:45:34 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:45:34 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a7065558-cd2a-45b9-b69a-b6a3692a2a2b tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Returning 404 to user: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23c3f228-883a-4913-8553-6ae59a1f8ad7 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23c3f228-883a-4913-8553-6ae59a1f8ad7 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:34 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a7065558-cd2a-45b9-b69a-b6a3692a2a2b tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.055196 Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23c3f228-883a-4913-8553-6ae59a1f8ad7 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:34 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 73/210] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:45:34 2023] GET /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/os-volume_attachments => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23c3f228-883a-4913-8553-6ae59a1f8ad7 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23c3f228-883a-4913-8553-6ae59a1f8ad7 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23c3f228-883a-4913-8553-6ae59a1f8ad7 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-23c3f228-883a-4913-8553-6ae59a1f8ad7 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059973 Apr 14 10:45:34 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 70/211] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:45:34 2023] GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:34 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4cfc127d-dadf-4588-9781-c90f1906df63"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:34 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:34 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=27 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:45:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:35 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:45:35 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments/87bf508a-fb5e-40aa-abb8-ca896d37d55f" status: 202 len: 0 microversion: 2.1 time: 0.628552 Apr 14 10:45:35 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 69/212] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 10:45:34 2023] PUT /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments/87bf508a-fb5e-40aa-abb8-ca896d37d55f => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:45:36 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-2b5101a6-904d-402c-aab2-681a766ad7e5 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:36 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-2b5101a6-904d-402c-aab2-681a766ad7e5 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2b5101a6-904d-402c-aab2-681a766ad7e5 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2b5101a6-904d-402c-aab2-681a766ad7e5 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2b5101a6-904d-402c-aab2-681a766ad7e5 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2b5101a6-904d-402c-aab2-681a766ad7e5 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2b5101a6-904d-402c-aab2-681a766ad7e5 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2b5101a6-904d-402c-aab2-681a766ad7e5 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:36 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-2b5101a6-904d-402c-aab2-681a766ad7e5 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c4ab86a8d244c4be5889b4ac47561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e1e1695464eb5ad8a8c881cf24611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:36 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-2b5101a6-904d-402c-aab2-681a766ad7e5 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606" status: 200 len: 1432 microversion: 2.1 time: 0.167543 Apr 14 10:45:36 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 74/213] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:45:36 2023] GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606 => generated 1432 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 10:45:38 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-09c434c3-30c9-45fb-a8a3-ef54b5c19437 req-d0ac2ef7-4759-4c4c-a080-bae3dca142b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39586d44-1d8e-4607-ab4d-c03a7d841606", "tag": "6099437e-5607-4a06-abcb-15d465c7ecf8"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:38 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:45:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-09c434c3-30c9-45fb-a8a3-ef54b5c19437 req-d0ac2ef7-4759-4c4c-a080-bae3dca142b9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-09c434c3-30c9-45fb-a8a3-ef54b5c19437 req-d0ac2ef7-4759-4c4c-a080-bae3dca142b9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-09c434c3-30c9-45fb-a8a3-ef54b5c19437 req-d0ac2ef7-4759-4c4c-a080-bae3dca142b9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:38 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f48bcb45-decd-4e3e-a2e8-bc7fa2cefc83 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-f48bcb45-decd-4e3e-a2e8-bc7fa2cefc83 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f48bcb45-decd-4e3e-a2e8-bc7fa2cefc83 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f48bcb45-decd-4e3e-a2e8-bc7fa2cefc83 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f48bcb45-decd-4e3e-a2e8-bc7fa2cefc83 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f48bcb45-decd-4e3e-a2e8-bc7fa2cefc83 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f48bcb45-decd-4e3e-a2e8-bc7fa2cefc83 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f48bcb45-decd-4e3e-a2e8-bc7fa2cefc83 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:38 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-09c434c3-30c9-45fb-a8a3-ef54b5c19437 req-d0ac2ef7-4759-4c4c-a080-bae3dca142b9 service nova] Creating event network-changed:6099437e-5607-4a06-abcb-15d465c7ecf8 for instance 39586d44-1d8e-4607-ab4d-c03a7d841606 on user Apr 14 10:45:38 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-09c434c3-30c9-45fb-a8a3-ef54b5c19437 req-d0ac2ef7-4759-4c4c-a080-bae3dca142b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043945 Apr 14 10:45:38 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 71/214] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:38 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-f48bcb45-decd-4e3e-a2e8-bc7fa2cefc83 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] HTTP exception thrown: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f48bcb45-decd-4e3e-a2e8-bc7fa2cefc83 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Request method failure captured: Apr 14 10:45:38 user devstack@n-api.service[61839]: request: DELETE /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a HTTP/1.1 Apr 14 10:45:38 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:45:38 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:45:38 user devstack@n-api.service[61839]: Connection: close Apr 14 10:45:38 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:45:38 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:45:38 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:45:38 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:45:38 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:45:38 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS4cvZe2WQdsZ8yN8qobpJhJh5ddT2oF5E4UibVRaJfgPnXdygUDM6q_5mb9rkR4kD6VS_tAx72REqtt3V1wwUF8E7EwzEEhUHskduq4ZHzNQ5IGMgNWRTsBpEwCWdG91qPf2yoO_ec7GBQekpcg_1zN4FzP0dBXWRRykxfJHq2d-oY Apr 14 10:45:38 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:45:38 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:45:38 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:45:38 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:45:38 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:45:38 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:45:38 user devstack@n-api.service[61839]: X-Project-Id: 30856983340a435d8e92f138fdecaa35 Apr 14 10:45:38 user devstack@n-api.service[61839]: X-Project-Name: tempest-DeleteServersTestJSON-1788928325 Apr 14 10:45:38 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:45:38 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:45:38 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/30856983340a435d8e92f138fdecaa35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/30856983340a435d8e92f138fdecaa35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/30856983340a435d8e92f138fdecaa35"}]}] Apr 14 10:45:38 user devstack@n-api.service[61839]: X-Tenant: tempest-DeleteServersTestJSON-1788928325 Apr 14 10:45:38 user devstack@n-api.service[61839]: X-Tenant-Id: 30856983340a435d8e92f138fdecaa35 Apr 14 10:45:38 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-DeleteServersTestJSON-1788928325 Apr 14 10:45:38 user devstack@n-api.service[61839]: X-User: tempest-DeleteServersTestJSON-1788928325-project-member Apr 14 10:45:38 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:45:38 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:45:38 user devstack@n-api.service[61839]: X-User-Id: 0a9842a4c91c4d45b52da0b404fc27c2 Apr 14 10:45:38 user devstack@n-api.service[61839]: X-User-Name: tempest-DeleteServersTestJSON-1788928325-project-member Apr 14 10:45:38 user devstack@n-api.service[61839]: method: > Apr 14 10:45:38 user devstack@n-api.service[61839]: exception: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:38 user devstack@n-api.service[61839]: action_args: {'id': 'c90a9b99-0985-403b-b4d8-eaa8c2eed88a'} Apr 14 10:45:38 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:38 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f48bcb45-decd-4e3e-a2e8-bc7fa2cefc83 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Returning 404 to user: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:45:38 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-f48bcb45-decd-4e3e-a2e8-bc7fa2cefc83 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a" status: 404 len: 111 microversion: 2.1 time: 0.051131 Apr 14 10:45:38 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 70/215] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:45:38 2023] DELETE /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:45:38 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9becbfda-9595-4308-baa5-4c252e129643 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:38 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-9becbfda-9595-4308-baa5-4c252e129643 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9becbfda-9595-4308-baa5-4c252e129643 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9becbfda-9595-4308-baa5-4c252e129643 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9becbfda-9595-4308-baa5-4c252e129643 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9becbfda-9595-4308-baa5-4c252e129643 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9becbfda-9595-4308-baa5-4c252e129643 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9becbfda-9595-4308-baa5-4c252e129643 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:38 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-9becbfda-9595-4308-baa5-4c252e129643 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] HTTP exception thrown: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:38 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9becbfda-9595-4308-baa5-4c252e129643 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Request method failure captured: Apr 14 10:45:38 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a HTTP/1.1 Apr 14 10:45:38 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:45:38 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:45:38 user devstack@n-api.service[61841]: Connection: close Apr 14 10:45:38 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 10:45:38 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:45:38 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:45:38 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:45:38 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:45:38 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4cvZe2WQdsZ8yN8qobpJhJh5ddT2oF5E4UibVRaJfgPnXdygUDM6q_5mb9rkR4kD6VS_tAx72REqtt3V1wwUF8E7EwzEEhUHskduq4ZHzNQ5IGMgNWRTsBpEwCWdG91qPf2yoO_ec7GBQekpcg_1zN4FzP0dBXWRRykxfJHq2d-oY Apr 14 10:45:38 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:45:38 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:45:38 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:45:38 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:45:38 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:45:38 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:45:38 user devstack@n-api.service[61841]: X-Project-Id: 30856983340a435d8e92f138fdecaa35 Apr 14 10:45:38 user devstack@n-api.service[61841]: X-Project-Name: tempest-DeleteServersTestJSON-1788928325 Apr 14 10:45:38 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:45:38 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:45:38 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/30856983340a435d8e92f138fdecaa35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/30856983340a435d8e92f138fdecaa35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/30856983340a435d8e92f138fdecaa35"}]}] Apr 14 10:45:38 user devstack@n-api.service[61841]: X-Tenant: tempest-DeleteServersTestJSON-1788928325 Apr 14 10:45:38 user devstack@n-api.service[61841]: X-Tenant-Id: 30856983340a435d8e92f138fdecaa35 Apr 14 10:45:38 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-DeleteServersTestJSON-1788928325 Apr 14 10:45:38 user devstack@n-api.service[61841]: X-User: tempest-DeleteServersTestJSON-1788928325-project-member Apr 14 10:45:38 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:45:38 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:45:38 user devstack@n-api.service[61841]: X-User-Id: 0a9842a4c91c4d45b52da0b404fc27c2 Apr 14 10:45:38 user devstack@n-api.service[61841]: X-User-Name: tempest-DeleteServersTestJSON-1788928325-project-member Apr 14 10:45:38 user devstack@n-api.service[61841]: method: > Apr 14 10:45:38 user devstack@n-api.service[61841]: exception: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:38 user devstack@n-api.service[61841]: action_args: {'id': 'c90a9b99-0985-403b-b4d8-eaa8c2eed88a'} Apr 14 10:45:38 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. Apr 14 10:45:38 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:45:38 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9becbfda-9595-4308-baa5-4c252e129643 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Returning 404 to user: Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:45:38 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-9becbfda-9595-4308-baa5-4c252e129643 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a" status: 404 len: 111 microversion: 2.1 time: 0.031011 Apr 14 10:45:38 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 75/216] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:45:38 2023] GET /compute/v2.1/servers/c90a9b99-0985-403b-b4d8-eaa8c2eed88a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:45:38 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:38 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:38 user devstack@n-api.service[61840]: DEBUG nova.objects.instance [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lazy-loading 'flavor' on Instance uuid 39586d44-1d8e-4607-ab4d-c03a7d841606 {{(pid=61840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:45:38 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 10.0.0.210 "POST /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606/action" status: 202 len: 0 microversion: 2.1 time: 0.166067 Apr 14 10:45:38 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 72/217] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:45:38 2023] POST /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-5527f624-3f9f-48b5-b14d-6c12a19692c3 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-5527f624-3f9f-48b5-b14d-6c12a19692c3 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5527f624-3f9f-48b5-b14d-6c12a19692c3 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5527f624-3f9f-48b5-b14d-6c12a19692c3 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5527f624-3f9f-48b5-b14d-6c12a19692c3 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5527f624-3f9f-48b5-b14d-6c12a19692c3 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5527f624-3f9f-48b5-b14d-6c12a19692c3 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5527f624-3f9f-48b5-b14d-6c12a19692c3 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:39 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-5527f624-3f9f-48b5-b14d-6c12a19692c3 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c4ab86a8d244c4be5889b4ac47561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e1e1695464eb5ad8a8c881cf24611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:39 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-5527f624-3f9f-48b5-b14d-6c12a19692c3 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606" status: 200 len: 1438 microversion: 2.1 time: 0.187909 Apr 14 10:45:39 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 71/218] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:45:38 2023] GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606 => generated 1438 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:45:39 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a5955b9d-a03e-48dd-83f0-c8fd6cc5fa3b tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '.version_select at 0x7fcd1d23d900>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:39 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a5955b9d-a03e-48dd-83f0-c8fd6cc5fa3b tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "GET /compute/v2.1/images/aefc0dd9-6bb6-4a2f-ada9-e21b5f4d6151" status: 200 len: 1724 microversion: 2.1 time: 0.072281 Apr 14 10:45:39 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 76/219] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 10:45:39 2023] GET /compute/v2.1/images/aefc0dd9-6bb6-4a2f-ada9-e21b5f4d6151 => generated 1724 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:45:39 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-e627fccb-6b09-4862-b9dd-e8ff0cce89b9 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '.version_select at 0x7fcd1d28d900>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:39 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-e627fccb-6b09-4862-b9dd-e8ff0cce89b9 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "GET /compute/v2.1/images/aefc0dd9-6bb6-4a2f-ada9-e21b5f4d6151" status: 200 len: 1724 microversion: 2.1 time: 0.055717 Apr 14 10:45:39 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 73/220] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 10:45:39 2023] GET /compute/v2.1/images/aefc0dd9-6bb6-4a2f-ada9-e21b5f4d6151 => generated 1724 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:45:39 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-589986e8-8b79-4151-93a9-774914c01a06 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:39 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-589986e8-8b79-4151-93a9-774914c01a06 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-589986e8-8b79-4151-93a9-774914c01a06 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-589986e8-8b79-4151-93a9-774914c01a06 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-589986e8-8b79-4151-93a9-774914c01a06 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-589986e8-8b79-4151-93a9-774914c01a06 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-589986e8-8b79-4151-93a9-774914c01a06 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-589986e8-8b79-4151-93a9-774914c01a06 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:39 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-dc8e259b-a0f5-4e87-b3c7-1d135e5fbd0f req-2c398f39-7efa-4ae1-ba41-4f4138680665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39586d44-1d8e-4607-ab4d-c03a7d841606", "name": "network-vif-unplugged", "status": "completed", "tag": "6099437e-5607-4a06-abcb-15d465c7ecf8"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:39 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:45:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-dc8e259b-a0f5-4e87-b3c7-1d135e5fbd0f req-2c398f39-7efa-4ae1-ba41-4f4138680665 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-dc8e259b-a0f5-4e87-b3c7-1d135e5fbd0f req-2c398f39-7efa-4ae1-ba41-4f4138680665 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-dc8e259b-a0f5-4e87-b3c7-1d135e5fbd0f req-2c398f39-7efa-4ae1-ba41-4f4138680665 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:39 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:45:39 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-dc8e259b-a0f5-4e87-b3c7-1d135e5fbd0f req-2c398f39-7efa-4ae1-ba41-4f4138680665 service nova] Creating event network-vif-unplugged:6099437e-5607-4a06-abcb-15d465c7ecf8 for instance 39586d44-1d8e-4607-ab4d-c03a7d841606 on user Apr 14 10:45:39 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-dc8e259b-a0f5-4e87-b3c7-1d135e5fbd0f req-2c398f39-7efa-4ae1-ba41-4f4138680665 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049626 Apr 14 10:45:39 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 77/221] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:39 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-589986e8-8b79-4151-93a9-774914c01a06 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7212c3fe50ef465c99a0eefec4cbd753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482809b9148e408b84b156802a21a225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:39 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-589986e8-8b79-4151-93a9-774914c01a06 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce" status: 200 len: 1671 microversion: 2.1 time: 0.190669 Apr 14 10:45:39 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 72/222] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:45:39 2023] GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce => generated 1671 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:45:41 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-cd5c512b-2dab-49e7-93ed-a6faffb4593f tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:41 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-cd5c512b-2dab-49e7-93ed-a6faffb4593f tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cd5c512b-2dab-49e7-93ed-a6faffb4593f tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cd5c512b-2dab-49e7-93ed-a6faffb4593f tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cd5c512b-2dab-49e7-93ed-a6faffb4593f tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cd5c512b-2dab-49e7-93ed-a6faffb4593f tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cd5c512b-2dab-49e7-93ed-a6faffb4593f tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cd5c512b-2dab-49e7-93ed-a6faffb4593f tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:41 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39586d44-1d8e-4607-ab4d-c03a7d841606", "name": "network-vif-plugged", "status": "completed", "tag": "6099437e-5607-4a06-abcb-15d465c7ecf8"}, {"name": "network-changed", "server_uuid": "39586d44-1d8e-4607-ab4d-c03a7d841606", "tag": "6099437e-5607-4a06-abcb-15d465c7ecf8"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:41 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] Creating event network-vif-plugged:6099437e-5607-4a06-abcb-15d465c7ecf8 for instance 39586d44-1d8e-4607-ab4d-c03a7d841606 on user Apr 14 10:45:41 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] Creating event network-changed:6099437e-5607-4a06-abcb-15d465c7ecf8 for instance 39586d44-1d8e-4607-ab4d-c03a7d841606 on user Apr 14 10:45:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-cd5c512b-2dab-49e7-93ed-a6faffb4593f tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.153742 Apr 14 10:45:41 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037392 Apr 14 10:45:41 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 74/223] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 10:45:41 2023] GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca/os-interface => generated 1829 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:45:41 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 78/224] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:41 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:43 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-bc5ecd95-5fb6-4614-ab0c-1b1e0740e19c tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:43 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-bc5ecd95-5fb6-4614-ab0c-1b1e0740e19c tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bc5ecd95-5fb6-4614-ab0c-1b1e0740e19c tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bc5ecd95-5fb6-4614-ab0c-1b1e0740e19c tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bc5ecd95-5fb6-4614-ab0c-1b1e0740e19c tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bc5ecd95-5fb6-4614-ab0c-1b1e0740e19c tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bc5ecd95-5fb6-4614-ab0c-1b1e0740e19c tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bc5ecd95-5fb6-4614-ab0c-1b1e0740e19c tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:43 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-bc5ecd95-5fb6-4614-ab0c-1b1e0740e19c tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3579ac20f8094f5a9fbd036ed05cda23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f701119cef78433280cbddf2adf685db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:43 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-bc5ecd95-5fb6-4614-ab0c-1b1e0740e19c tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3579ac20f8094f5a9fbd036ed05cda23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f701119cef78433280cbddf2adf685db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:43 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-bc5ecd95-5fb6-4614-ab0c-1b1e0740e19c tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3579ac20f8094f5a9fbd036ed05cda23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f701119cef78433280cbddf2adf685db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:43 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-bc5ecd95-5fb6-4614-ab0c-1b1e0740e19c tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca" status: 200 len: 2823 microversion: 2.42 time: 0.251950 Apr 14 10:45:43 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 73/225] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:45:43 2023] GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca => generated 2823 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:45:43 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-cfec2043-52af-4648-b8db-b879cabb8b58 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:43 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-cfec2043-52af-4648-b8db-b879cabb8b58 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cfec2043-52af-4648-b8db-b879cabb8b58 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cfec2043-52af-4648-b8db-b879cabb8b58 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cfec2043-52af-4648-b8db-b879cabb8b58 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cfec2043-52af-4648-b8db-b879cabb8b58 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cfec2043-52af-4648-b8db-b879cabb8b58 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cfec2043-52af-4648-b8db-b879cabb8b58 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:43 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-cfec2043-52af-4648-b8db-b879cabb8b58 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.120188 Apr 14 10:45:43 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 75/226] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 10:45:43 2023] GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca/os-interface => generated 1829 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:45:43 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-fbb061af-179c-4fa0-a8dc-59fc3cc341f2 req-f8915b58-7a87-4221-825e-73120c9868e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "tag": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-fbb061af-179c-4fa0-a8dc-59fc3cc341f2 req-f8915b58-7a87-4221-825e-73120c9868e0 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-fbb061af-179c-4fa0-a8dc-59fc3cc341f2 req-f8915b58-7a87-4221-825e-73120c9868e0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-fbb061af-179c-4fa0-a8dc-59fc3cc341f2 req-f8915b58-7a87-4221-825e-73120c9868e0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:43 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-fbb061af-179c-4fa0-a8dc-59fc3cc341f2 req-f8915b58-7a87-4221-825e-73120c9868e0 service nova] Creating event network-changed:2b341364-55e1-439f-9a3b-2b2fb7ad33b7 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:43 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-fbb061af-179c-4fa0-a8dc-59fc3cc341f2 req-f8915b58-7a87-4221-825e-73120c9868e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032422 Apr 14 10:45:43 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 79/227] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:45 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:45 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:45 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:45 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:45 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:45 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:45 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:45 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:45 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:45:45 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca" status: 204 len: 0 microversion: 2.42 time: 0.220102 Apr 14 10:45:45 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 74/228] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 10:45:45 2023] DELETE /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 10:45:45 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d25ea552-8637-4d00-a9df-abf8f7df2bb2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:45 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-d25ea552-8637-4d00-a9df-abf8f7df2bb2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:45 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d25ea552-8637-4d00-a9df-abf8f7df2bb2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:45 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d25ea552-8637-4d00-a9df-abf8f7df2bb2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:45 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d25ea552-8637-4d00-a9df-abf8f7df2bb2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:45 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d25ea552-8637-4d00-a9df-abf8f7df2bb2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:45 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d25ea552-8637-4d00-a9df-abf8f7df2bb2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:45 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d25ea552-8637-4d00-a9df-abf8f7df2bb2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:45 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-b10e3292-2b78-421e-8efe-6997ee41731b tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:45 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-b10e3292-2b78-421e-8efe-6997ee41731b tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b10e3292-2b78-421e-8efe-6997ee41731b tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b10e3292-2b78-421e-8efe-6997ee41731b tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b10e3292-2b78-421e-8efe-6997ee41731b tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b10e3292-2b78-421e-8efe-6997ee41731b tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b10e3292-2b78-421e-8efe-6997ee41731b tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b10e3292-2b78-421e-8efe-6997ee41731b tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:45 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-b10e3292-2b78-421e-8efe-6997ee41731b tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.298829 Apr 14 10:45:45 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 80/229] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 10:45:45 2023] GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e/os-interface => generated 1828 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:45:46 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-d25ea552-8637-4d00-a9df-abf8f7df2bb2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3579ac20f8094f5a9fbd036ed05cda23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f701119cef78433280cbddf2adf685db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:46 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-d25ea552-8637-4d00-a9df-abf8f7df2bb2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3579ac20f8094f5a9fbd036ed05cda23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f701119cef78433280cbddf2adf685db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:46 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-d25ea552-8637-4d00-a9df-abf8f7df2bb2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3579ac20f8094f5a9fbd036ed05cda23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f701119cef78433280cbddf2adf685db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:46 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d25ea552-8637-4d00-a9df-abf8f7df2bb2 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca" status: 200 len: 2948 microversion: 2.42 time: 0.626696 Apr 14 10:45:46 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 76/230] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:45:45 2023] GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca => generated 2948 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:45:46 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-4c2609b2-ae87-4ec9-8484-730c170f262c req-4a8db9d6-475d-49a5-a13c-2d41baefb301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-unplugged", "status": "completed", "tag": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4c2609b2-ae87-4ec9-8484-730c170f262c req-4a8db9d6-475d-49a5-a13c-2d41baefb301 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4c2609b2-ae87-4ec9-8484-730c170f262c req-4a8db9d6-475d-49a5-a13c-2d41baefb301 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4c2609b2-ae87-4ec9-8484-730c170f262c req-4a8db9d6-475d-49a5-a13c-2d41baefb301 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-4c2609b2-ae87-4ec9-8484-730c170f262c req-4a8db9d6-475d-49a5-a13c-2d41baefb301 service nova] Creating event network-vif-unplugged:2b341364-55e1-439f-9a3b-2b2fb7ad33b7 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-4c2609b2-ae87-4ec9-8484-730c170f262c req-4a8db9d6-475d-49a5-a13c-2d41baefb301 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050802 Apr 14 10:45:46 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 75/231] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:46 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-195b1736-a0d1-4abe-8b92-0ea9953495db req-c226bcad-f7a5-47e7-b8f0-18654fdfd52c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-unplugged", "status": "completed", "tag": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-195b1736-a0d1-4abe-8b92-0ea9953495db req-c226bcad-f7a5-47e7-b8f0-18654fdfd52c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-195b1736-a0d1-4abe-8b92-0ea9953495db req-c226bcad-f7a5-47e7-b8f0-18654fdfd52c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-195b1736-a0d1-4abe-8b92-0ea9953495db req-c226bcad-f7a5-47e7-b8f0-18654fdfd52c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:46 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-195b1736-a0d1-4abe-8b92-0ea9953495db req-c226bcad-f7a5-47e7-b8f0-18654fdfd52c service nova] Creating event network-vif-unplugged:8789c03e-397c-439a-8bc5-5d8ce5fc36ac for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:46 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-195b1736-a0d1-4abe-8b92-0ea9953495db req-c226bcad-f7a5-47e7-b8f0-18654fdfd52c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077618 Apr 14 10:45:46 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 81/232] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:47 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-86c41a80-1366-4dce-bd6d-499f11c5c7f9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:47 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-86c41a80-1366-4dce-bd6d-499f11c5c7f9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-86c41a80-1366-4dce-bd6d-499f11c5c7f9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-86c41a80-1366-4dce-bd6d-499f11c5c7f9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-86c41a80-1366-4dce-bd6d-499f11c5c7f9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-86c41a80-1366-4dce-bd6d-499f11c5c7f9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-86c41a80-1366-4dce-bd6d-499f11c5c7f9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-86c41a80-1366-4dce-bd6d-499f11c5c7f9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:48 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-86c41a80-1366-4dce-bd6d-499f11c5c7f9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6dac34303f4965babaee39bb363b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e024f5a578e4543a02c6adc7d456f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:48 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-86c41a80-1366-4dce-bd6d-499f11c5c7f9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f6dac34303f4965babaee39bb363b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e024f5a578e4543a02c6adc7d456f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:48 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-86c41a80-1366-4dce-bd6d-499f11c5c7f9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f6dac34303f4965babaee39bb363b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e024f5a578e4543a02c6adc7d456f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:48 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-86c41a80-1366-4dce-bd6d-499f11c5c7f9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e" status: 200 len: 2823 microversion: 2.32 time: 0.293333 Apr 14 10:45:48 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 77/233] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:45:47 2023] GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e => generated 2823 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:45:48 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-ffc38d12-8d24-4f9e-b9f5-151415afe28c tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:48 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-ffc38d12-8d24-4f9e-b9f5-151415afe28c tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ffc38d12-8d24-4f9e-b9f5-151415afe28c tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ffc38d12-8d24-4f9e-b9f5-151415afe28c tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ffc38d12-8d24-4f9e-b9f5-151415afe28c tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ffc38d12-8d24-4f9e-b9f5-151415afe28c tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ffc38d12-8d24-4f9e-b9f5-151415afe28c tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ffc38d12-8d24-4f9e-b9f5-151415afe28c tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:48 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-unplugged", "status": "completed", "tag": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-unplugged", "status": "completed", "tag": "d2d71e67-1807-43cf-8753-7bdd77de6317"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "d2d71e67-1807-43cf-8753-7bdd77de6317"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-unplugged", "status": "completed", "tag": "c46b5082-6634-4c7f-89c1-7e58a3cd8987"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "c46b5082-6634-4c7f-89c1-7e58a3cd8987"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-unplugged", "status": "completed", "tag": "84e561e8-01c6-4d50-ab37-bc64b5509e31"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:48 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Creating event network-vif-plugged:2b341364-55e1-439f-9a3b-2b2fb7ad33b7 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:48 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Creating event network-vif-unplugged:f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:48 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Creating event network-vif-plugged:f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:48 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Creating event network-vif-unplugged:d2d71e67-1807-43cf-8753-7bdd77de6317 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:48 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Creating event network-vif-plugged:d2d71e67-1807-43cf-8753-7bdd77de6317 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:48 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Creating event network-vif-unplugged:c46b5082-6634-4c7f-89c1-7e58a3cd8987 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:48 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Creating event network-vif-plugged:c46b5082-6634-4c7f-89c1-7e58a3cd8987 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:48 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Creating event network-vif-unplugged:84e561e8-01c6-4d50-ab37-bc64b5509e31 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:48 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1388 microversion: 2.1 time: 0.042103 Apr 14 10:45:48 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 82/234] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 10:45:48 2023] POST /compute/v2.1/os-server-external-events => generated 1388 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:45:48 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-unplugged", "status": "completed", "tag": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22"}, {"name": "network-changed", "server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "tag": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:48 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-ffc38d12-8d24-4f9e-b9f5-151415afe28c tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.521796 Apr 14 10:45:48 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 76/235] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 10:45:48 2023] GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e/os-interface => generated 1828 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:45:48 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:48 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:48 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:48 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Creating event network-vif-plugged:8789c03e-397c-439a-8bc5-5d8ce5fc36ac for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:48 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Creating event network-vif-unplugged:717e6c20-676e-40f2-b4c1-47ca0f3e6f22 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:48 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Creating event network-changed:2a2ef05a-2d58-4cdf-ab6c-35df823a68bc for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:48 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Creating event network-vif-plugged:717e6c20-676e-40f2-b4c1-47ca0f3e6f22 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:48 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 694 microversion: 2.1 time: 0.042107 Apr 14 10:45:48 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 78/236] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:48 2023] POST /compute/v2.1/os-server-external-events => generated 694 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-3b74f4cd-57f7-4eee-a2ef-3aca3ab16e07 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-3b74f4cd-57f7-4eee-a2ef-3aca3ab16e07 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3b74f4cd-57f7-4eee-a2ef-3aca3ab16e07 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3b74f4cd-57f7-4eee-a2ef-3aca3ab16e07 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3b74f4cd-57f7-4eee-a2ef-3aca3ab16e07 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3b74f4cd-57f7-4eee-a2ef-3aca3ab16e07 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3b74f4cd-57f7-4eee-a2ef-3aca3ab16e07 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3b74f4cd-57f7-4eee-a2ef-3aca3ab16e07 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:49 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-3b74f4cd-57f7-4eee-a2ef-3aca3ab16e07 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049823 Apr 14 10:45:49 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 83/237] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:45:49 2023] GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-c99ee930-ec1a-4e9d-91a5-38ec49eee91f tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-c99ee930-ec1a-4e9d-91a5-38ec49eee91f tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c99ee930-ec1a-4e9d-91a5-38ec49eee91f tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c99ee930-ec1a-4e9d-91a5-38ec49eee91f tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c99ee930-ec1a-4e9d-91a5-38ec49eee91f tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c99ee930-ec1a-4e9d-91a5-38ec49eee91f tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c99ee930-ec1a-4e9d-91a5-38ec49eee91f tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c99ee930-ec1a-4e9d-91a5-38ec49eee91f tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:49 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:49 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-c99ee930-ec1a-4e9d-91a5-38ec49eee91f tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048714 Apr 14 10:45:49 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:49 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 77/238] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:45:49 2023] GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:49 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Going to try to terminate instance {{(pid=61840) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e" status: 204 len: 0 microversion: 2.32 time: 0.111770 Apr 14 10:45:49 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 79/239] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 10:45:49 2023] DELETE /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-9dc2c923-b233-498d-aacf-fd30ce6d4655 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-9dc2c923-b233-498d-aacf-fd30ce6d4655 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9dc2c923-b233-498d-aacf-fd30ce6d4655 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9dc2c923-b233-498d-aacf-fd30ce6d4655 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9dc2c923-b233-498d-aacf-fd30ce6d4655 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9dc2c923-b233-498d-aacf-fd30ce6d4655 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9dc2c923-b233-498d-aacf-fd30ce6d4655 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9dc2c923-b233-498d-aacf-fd30ce6d4655 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:50 user devstack@n-api.service[61841]: DEBUG nova.objects.instance [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lazy-loading 'services' on Instance uuid d6f539d8-4144-467b-ac69-44011c5b3564 {{(pid=61841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:45:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments/4cfc127d-dadf-4588-9781-c90f1906df63" status: 202 len: 0 microversion: 2.1 time: 0.306864 Apr 14 10:45:50 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 84/240] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:45:49 2023] DELETE /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments/4cfc127d-dadf-4588-9781-c90f1906df63 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:45:50 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-801deeae-87c9-40de-ba85-b339b394081e tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:50 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-801deeae-87c9-40de-ba85-b339b394081e tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-801deeae-87c9-40de-ba85-b339b394081e tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-801deeae-87c9-40de-ba85-b339b394081e tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-801deeae-87c9-40de-ba85-b339b394081e tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-801deeae-87c9-40de-ba85-b339b394081e tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-801deeae-87c9-40de-ba85-b339b394081e tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-801deeae-87c9-40de-ba85-b339b394081e tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:50 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-9dc2c923-b233-498d-aacf-fd30ce6d4655 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6dac34303f4965babaee39bb363b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e024f5a578e4543a02c6adc7d456f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-801deeae-87c9-40de-ba85-b339b394081e tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065381 Apr 14 10:45:50 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 80/241] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:45:50 2023] GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:50 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-9dc2c923-b233-498d-aacf-fd30ce6d4655 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f6dac34303f4965babaee39bb363b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e024f5a578e4543a02c6adc7d456f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:50 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-9dc2c923-b233-498d-aacf-fd30ce6d4655 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f6dac34303f4965babaee39bb363b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e024f5a578e4543a02c6adc7d456f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:50 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-9dc2c923-b233-498d-aacf-fd30ce6d4655 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e" status: 200 len: 2948 microversion: 2.32 time: 0.358857 Apr 14 10:45:50 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 78/242] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:45:49 2023] GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e => generated 2948 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:45:50 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-778b5dc0-f353-45ce-a8b4-daf1b856562a req-1770bc21-2f10-4a1d-b677-10fa17a002ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-unplugged", "status": "completed", "tag": "23214923-0217-4046-9a68-675f2ee8e42d"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-778b5dc0-f353-45ce-a8b4-daf1b856562a req-1770bc21-2f10-4a1d-b677-10fa17a002ba service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-778b5dc0-f353-45ce-a8b4-daf1b856562a req-1770bc21-2f10-4a1d-b677-10fa17a002ba service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-778b5dc0-f353-45ce-a8b4-daf1b856562a req-1770bc21-2f10-4a1d-b677-10fa17a002ba service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-778b5dc0-f353-45ce-a8b4-daf1b856562a req-1770bc21-2f10-4a1d-b677-10fa17a002ba service nova] Creating event network-vif-unplugged:23214923-0217-4046-9a68-675f2ee8e42d for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-778b5dc0-f353-45ce-a8b4-daf1b856562a req-1770bc21-2f10-4a1d-b677-10fa17a002ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030307 Apr 14 10:45:50 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 85/243] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:50 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-plugged", "status": "completed", "tag": "84e561e8-01c6-4d50-ab37-bc64b5509e31"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-unplugged", "status": "completed", "tag": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] Creating event network-vif-plugged:84e561e8-01c6-4d50-ab37-bc64b5509e31 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] Creating event network-vif-unplugged:2a2ef05a-2d58-4cdf-ab6c-35df823a68bc for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.064595 Apr 14 10:45:50 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 81/244] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:50 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:52 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "23214923-0217-4046-9a68-675f2ee8e42d"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-unplugged", "status": "completed", "tag": "4d65e4a1-4cea-4636-8ad8-21065de3c747"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "4d65e4a1-4cea-4636-8ad8-21065de3c747"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-unplugged", "status": "completed", "tag": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:52 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Creating event network-vif-plugged:23214923-0217-4046-9a68-675f2ee8e42d for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:52 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Creating event network-vif-unplugged:4d65e4a1-4cea-4636-8ad8-21065de3c747 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:52 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Creating event network-vif-plugged:4d65e4a1-4cea-4636-8ad8-21065de3c747 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:52 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Creating event network-vif-unplugged:d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:52 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Creating event network-vif-plugged:d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:52 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.067668 Apr 14 10:45:52 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 79/245] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:52 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:45:52 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-unplugged", "status": "completed", "tag": "7f7db929-b2fd-4242-9d23-5d58a374f961"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "7f7db929-b2fd-4242-9d23-5d58a374f961"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-unplugged", "status": "completed", "tag": "328d2b64-7bc6-425a-b3a4-8cda754ffd56"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "328d2b64-7bc6-425a-b3a4-8cda754ffd56"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:52 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Creating event network-vif-plugged:2a2ef05a-2d58-4cdf-ab6c-35df823a68bc for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:52 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Creating event network-vif-unplugged:7f7db929-b2fd-4242-9d23-5d58a374f961 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:52 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Creating event network-vif-plugged:7f7db929-b2fd-4242-9d23-5d58a374f961 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:52 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Creating event network-vif-unplugged:328d2b64-7bc6-425a-b3a4-8cda754ffd56 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:52 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Creating event network-vif-plugged:328d2b64-7bc6-425a-b3a4-8cda754ffd56 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:52 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.033353 Apr 14 10:45:52 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 86/246] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:52 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:52 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-2d3e8b8a-da04-466d-a1c5-c421d97db575 req-45f76d78-d199-46db-a925-886e5e9d0550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-deleted", "tag": "c46b5082-6634-4c7f-89c1-7e58a3cd8987"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:52 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-2d3e8b8a-da04-466d-a1c5-c421d97db575 req-45f76d78-d199-46db-a925-886e5e9d0550 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:52 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-2d3e8b8a-da04-466d-a1c5-c421d97db575 req-45f76d78-d199-46db-a925-886e5e9d0550 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:52 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-2d3e8b8a-da04-466d-a1c5-c421d97db575 req-45f76d78-d199-46db-a925-886e5e9d0550 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-2d3e8b8a-da04-466d-a1c5-c421d97db575 req-45f76d78-d199-46db-a925-886e5e9d0550 service nova] Creating event network-vif-deleted:c46b5082-6634-4c7f-89c1-7e58a3cd8987 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-2d3e8b8a-da04-466d-a1c5-c421d97db575 req-45f76d78-d199-46db-a925-886e5e9d0550 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035723 Apr 14 10:45:53 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 82/247] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:45:53 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-b399411a-9cef-4bc7-9dcd-f814fe842972 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d29b5b0>, body: {"keypair": {"name": "tempest-keypair-1533515584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+BJG2hs5u25cAKxVjcO06DHIw9v85rt9ybRTOcJ5Z2J6Lwyi75EbIt/XGY4FaiJAg302gOYYve73U7hVGmBbLP+TE/GpIu0YYFEbftUPUQVwIX7wT/hvM2WJymZnJdhQ=="}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:53 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a3f6a7d4-6543-4842-9478-0944b1f10b3a tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:53 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-a3f6a7d4-6543-4842-9478-0944b1f10b3a tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:53 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-b399411a-9cef-4bc7-9dcd-f814fe842972 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Getting quotas for project f8a9941095d445f48d70df26d8c90e6c. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:45:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3f6a7d4-6543-4842-9478-0944b1f10b3a tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3f6a7d4-6543-4842-9478-0944b1f10b3a tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3f6a7d4-6543-4842-9478-0944b1f10b3a tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3f6a7d4-6543-4842-9478-0944b1f10b3a tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3f6a7d4-6543-4842-9478-0944b1f10b3a tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3f6a7d4-6543-4842-9478-0944b1f10b3a tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:53 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-b399411a-9cef-4bc7-9dcd-f814fe842972 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Getting quotas for user 5afd3930d3a14aff8124a4782ec79870 and project f8a9941095d445f48d70df26d8c90e6c. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:45:53 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-b399411a-9cef-4bc7-9dcd-f814fe842972 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.171237 Apr 14 10:45:53 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 80/248] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 10:45:53 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 173 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 10:45:53 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-a3f6a7d4-6543-4842-9478-0944b1f10b3a tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ed4663d8984fe7b5d95616281bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1696bf804b2e4d7f86162513015c8e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:53 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a3f6a7d4-6543-4842-9478-0944b1f10b3a tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c" status: 200 len: 1567 microversion: 2.1 time: 0.153541 Apr 14 10:45:53 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 87/249] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:45:53 2023] GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:45:54 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-unplugged", "status": "completed", "tag": "6e295a29-0297-49c0-9298-7d3a41a07585"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-plugged", "status": "completed", "tag": "6e295a29-0297-49c0-9298-7d3a41a07585"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:54 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:54 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:54 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:54 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] Creating event network-vif-unplugged:6e295a29-0297-49c0-9298-7d3a41a07585 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:54 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] Creating event network-vif-plugged:6e295a29-0297-49c0-9298-7d3a41a07585 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:54 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.053788 Apr 14 10:45:54 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 83/250] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:54 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:45:55 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-ea40573b-31c7-42ae-922c-890a3833fd7a req-5fe40df8-8d69-4cb3-8fcb-74c0eeed566f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-deleted", "tag": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-deleted", "tag": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-ea40573b-31c7-42ae-922c-890a3833fd7a req-5fe40df8-8d69-4cb3-8fcb-74c0eeed566f service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-ea40573b-31c7-42ae-922c-890a3833fd7a req-5fe40df8-8d69-4cb3-8fcb-74c0eeed566f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-ea40573b-31c7-42ae-922c-890a3833fd7a req-5fe40df8-8d69-4cb3-8fcb-74c0eeed566f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:55 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-ea40573b-31c7-42ae-922c-890a3833fd7a req-5fe40df8-8d69-4cb3-8fcb-74c0eeed566f service nova] Creating event network-vif-deleted:717e6c20-676e-40f2-b4c1-47ca0f3e6f22 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:55 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-ea40573b-31c7-42ae-922c-890a3833fd7a req-5fe40df8-8d69-4cb3-8fcb-74c0eeed566f service nova] Creating event network-vif-deleted:2b341364-55e1-439f-9a3b-2b2fb7ad33b7 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:55 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-ea40573b-31c7-42ae-922c-890a3833fd7a req-5fe40df8-8d69-4cb3-8fcb-74c0eeed566f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.058673 Apr 14 10:45:55 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 81/251] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:55 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1779641770", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1cb09253-66a4-4c81-82d0-c6d948e0aed4"}], "security_groups": [{"name": "tempest-securitygroup--791116744"}], "key_name": "tempest-keypair-1533515584", "user_data": "}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:55 user devstack@n-api.service[61841]: DEBUG nova.network.neutron [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] validate_networks() for [('1cb09253-66a4-4c81-82d0-c6d948e0aed4', None, None, None, None, None)] {{(pid=61841) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:45:55 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Flavor limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:45:55 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Image limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:45:55 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Flavor pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:45:55 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Image pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:45:55 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:45:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:56 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Getting quotas for project f8a9941095d445f48d70df26d8c90e6c. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:45:56 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Getting quotas for user 5afd3930d3a14aff8124a4782ec79870 and project f8a9941095d445f48d70df26d8c90e6c. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:45:56 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Going to run 1 instances... {{(pid=61841) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:45:56 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61841) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:45:56 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.749979 Apr 14 10:45:56 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 88/252] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 10:45:55 2023] POST /compute/v2.1/servers => generated 399 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 10:45:56 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d006eb02-bd18-4f6d-8c7a-a139f7cf25a1 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:45:56 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-d006eb02-bd18-4f6d-8c7a-a139f7cf25a1 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:56 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-d006eb02-bd18-4f6d-8c7a-a139f7cf25a1 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:56 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-d006eb02-bd18-4f6d-8c7a-a139f7cf25a1 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:56 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-d006eb02-bd18-4f6d-8c7a-a139f7cf25a1 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:45:56 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d006eb02-bd18-4f6d-8c7a-a139f7cf25a1 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae" status: 200 len: 1276 microversion: 2.20 time: 0.083108 Apr 14 10:45:56 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 84/253] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:45:56 2023] GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae => generated 1276 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:45:57 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-deleted", "tag": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac"}, {"server_uuid": "a81da242-e8d8-4b41-b84a-e12d603823ca", "name": "network-vif-deleted", "tag": "84e561e8-01c6-4d50-ab37-bc64b5509e31"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-deleted", "tag": "4d65e4a1-4cea-4636-8ad8-21065de3c747"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-deleted", "tag": "328d2b64-7bc6-425a-b3a4-8cda754ffd56"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:57 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:57 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:57 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:57 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] Creating event network-vif-deleted:8789c03e-397c-439a-8bc5-5d8ce5fc36ac for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:57 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] Creating event network-vif-deleted:84e561e8-01c6-4d50-ab37-bc64b5509e31 for instance a81da242-e8d8-4b41-b84a-e12d603823ca on user Apr 14 10:45:57 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] Creating event network-vif-deleted:4d65e4a1-4cea-4636-8ad8-21065de3c747 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:57 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] Creating event network-vif-deleted:328d2b64-7bc6-425a-b3a4-8cda754ffd56 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:57 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.044719 Apr 14 10:45:57 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 82/254] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:57 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:57 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-ba2f753c-fad3-4850-98ce-92fe7f3d2351 req-ee28baf5-2a2d-4ef2-bee6-582f445e08ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55178126-9766-4875-9122-39dcc87ce82c", "tag": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ba2f753c-fad3-4850-98ce-92fe7f3d2351 req-ee28baf5-2a2d-4ef2-bee6-582f445e08ef service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ba2f753c-fad3-4850-98ce-92fe7f3d2351 req-ee28baf5-2a2d-4ef2-bee6-582f445e08ef service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ba2f753c-fad3-4850-98ce-92fe7f3d2351 req-ee28baf5-2a2d-4ef2-bee6-582f445e08ef service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:57 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-ba2f753c-fad3-4850-98ce-92fe7f3d2351 req-ee28baf5-2a2d-4ef2-bee6-582f445e08ef service nova] Creating event network-changed:578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance 55178126-9766-4875-9122-39dcc87ce82c on user Apr 14 10:45:57 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-ba2f753c-fad3-4850-98ce-92fe7f3d2351 req-ee28baf5-2a2d-4ef2-bee6-582f445e08ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032760 Apr 14 10:45:57 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 89/255] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:58 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:58 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:45:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:58 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "POST /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328043 Apr 14 10:45:58 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 85/256] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:45:58 2023] POST /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:45:59 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-9af61b8b-c07f-48c6-81cf-4f568124c3bd req-bd1a9ad2-82df-4bb4-9fca-070b709f48d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-deleted", "tag": "6e295a29-0297-49c0-9298-7d3a41a07585"}, {"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-deleted", "tag": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:45:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9af61b8b-c07f-48c6-81cf-4f568124c3bd req-bd1a9ad2-82df-4bb4-9fca-070b709f48d2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:45:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9af61b8b-c07f-48c6-81cf-4f568124c3bd req-bd1a9ad2-82df-4bb4-9fca-070b709f48d2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:45:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9af61b8b-c07f-48c6-81cf-4f568124c3bd req-bd1a9ad2-82df-4bb4-9fca-070b709f48d2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:45:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-9af61b8b-c07f-48c6-81cf-4f568124c3bd req-bd1a9ad2-82df-4bb4-9fca-070b709f48d2 service nova] Creating event network-vif-deleted:6e295a29-0297-49c0-9298-7d3a41a07585 for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-9af61b8b-c07f-48c6-81cf-4f568124c3bd req-bd1a9ad2-82df-4bb4-9fca-070b709f48d2 service nova] Creating event network-vif-deleted:d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:45:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-9af61b8b-c07f-48c6-81cf-4f568124c3bd req-bd1a9ad2-82df-4bb4-9fca-070b709f48d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030677 Apr 14 10:45:59 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 83/257] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:45:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:01 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1516acc-354e-41f6-a639-61dea870b11e", "name": "network-vif-deleted", "tag": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc"}, {"name": "network-changed", "server_uuid": "4b767f1b-e97e-497c-8c70-8806203c76ae", "tag": "8d8a356d-c198-4e13-a489-5c626fbd025c"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:01 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] Creating event network-vif-deleted:2a2ef05a-2d58-4cdf-ab6c-35df823a68bc for instance d1516acc-354e-41f6-a639-61dea870b11e on user Apr 14 10:46:01 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] Creating event network-changed:8d8a356d-c198-4e13-a489-5c626fbd025c for instance 4b767f1b-e97e-497c-8c70-8806203c76ae on user Apr 14 10:46:01 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.036505 Apr 14 10:46:01 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 90/258] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:01 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:02 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-65c0f0e5-2f12-4d9a-b1e1-88b631722d57 req-b0b1ce85-29e0-4793-a035-608a16d8cc7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b767f1b-e97e-497c-8c70-8806203c76ae", "name": "network-vif-plugged", "status": "completed", "tag": "8d8a356d-c198-4e13-a489-5c626fbd025c"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-65c0f0e5-2f12-4d9a-b1e1-88b631722d57 req-b0b1ce85-29e0-4793-a035-608a16d8cc7c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-65c0f0e5-2f12-4d9a-b1e1-88b631722d57 req-b0b1ce85-29e0-4793-a035-608a16d8cc7c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-65c0f0e5-2f12-4d9a-b1e1-88b631722d57 req-b0b1ce85-29e0-4793-a035-608a16d8cc7c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:02 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-65c0f0e5-2f12-4d9a-b1e1-88b631722d57 req-b0b1ce85-29e0-4793-a035-608a16d8cc7c service nova] Creating event network-vif-plugged:8d8a356d-c198-4e13-a489-5c626fbd025c for instance 4b767f1b-e97e-497c-8c70-8806203c76ae on user Apr 14 10:46:02 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-65c0f0e5-2f12-4d9a-b1e1-88b631722d57 req-b0b1ce85-29e0-4793-a035-608a16d8cc7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055644 Apr 14 10:46:02 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 86/259] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:04 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:04 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-a5495a79-ab5f-4a14-bf93-16b020078439 req-36eec626-cbc6-46aa-89ba-088b6fc669e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b767f1b-e97e-497c-8c70-8806203c76ae", "name": "network-vif-plugged", "status": "completed", "tag": "8d8a356d-c198-4e13-a489-5c626fbd025c"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-a5495a79-ab5f-4a14-bf93-16b020078439 req-36eec626-cbc6-46aa-89ba-088b6fc669e0 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-a5495a79-ab5f-4a14-bf93-16b020078439 req-36eec626-cbc6-46aa-89ba-088b6fc669e0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-a5495a79-ab5f-4a14-bf93-16b020078439 req-36eec626-cbc6-46aa-89ba-088b6fc669e0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:04 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-a5495a79-ab5f-4a14-bf93-16b020078439 req-36eec626-cbc6-46aa-89ba-088b6fc669e0 service nova] Creating event network-vif-plugged:8d8a356d-c198-4e13-a489-5c626fbd025c for instance 4b767f1b-e97e-497c-8c70-8806203c76ae on user Apr 14 10:46:04 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-a5495a79-ab5f-4a14-bf93-16b020078439 req-36eec626-cbc6-46aa-89ba-088b6fc669e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028860 Apr 14 10:46:04 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 84/260] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:10 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-8c991406-c914-42aa-a91c-55743f1418f5 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:10 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-8c991406-c914-42aa-a91c-55743f1418f5 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:10 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:10 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:10 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:10 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8c991406-c914-42aa-a91c-55743f1418f5 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:10 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8c991406-c914-42aa-a91c-55743f1418f5 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:10 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8c991406-c914-42aa-a91c-55743f1418f5 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:10 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8c991406-c914-42aa-a91c-55743f1418f5 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:10 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8c991406-c914-42aa-a91c-55743f1418f5 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:10 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8c991406-c914-42aa-a91c-55743f1418f5 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:10 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:10 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-8c991406-c914-42aa-a91c-55743f1418f5 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] HTTP exception thrown: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. Apr 14 10:46:10 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-8c991406-c914-42aa-a91c-55743f1418f5 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Request method failure captured: Apr 14 10:46:10 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d HTTP/1.1 Apr 14 10:46:10 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:46:10 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:46:10 user devstack@n-api.service[61841]: Connection: close Apr 14 10:46:10 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 10:46:10 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:46:10 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:46:10 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:46:10 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:46:10 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4i7_opf6MPYr8ScaFK0UUSjedW4Z8a2x1pg2de8HlIawwyrM9_92cB18DW6V6gDItVJ7CvgmKPS0mkB5_7iNoRD7XnAjIGL_ZxwulmZB6HLnRIkPi8p8KyACTX2SrMFytOQ4MdvwWKLvgyn2WXxt2_8gwdmtbVZodjI4inf8Ex7Xo Apr 14 10:46:10 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:46:10 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:46:10 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:46:10 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:46:10 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:46:10 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:46:10 user devstack@n-api.service[61841]: X-Project-Id: 77068eae4fa9459fbe81026615d0c16d Apr 14 10:46:10 user devstack@n-api.service[61841]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1881116553 Apr 14 10:46:10 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:46:10 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:46:10 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77068eae4fa9459fbe81026615d0c16d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/77068eae4fa9459fbe81026615d0c16d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77068eae4fa9459fbe81026615d0c16d"}]}] Apr 14 10:46:10 user devstack@n-api.service[61841]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1881116553 Apr 14 10:46:10 user devstack@n-api.service[61841]: X-Tenant-Id: 77068eae4fa9459fbe81026615d0c16d Apr 14 10:46:10 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1881116553 Apr 14 10:46:10 user devstack@n-api.service[61841]: X-User: tempest-AttachSCSIVolumeTestJSON-1881116553-project-member Apr 14 10:46:10 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:46:10 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:46:10 user devstack@n-api.service[61841]: X-User-Id: 806d72cf0d0f4de3a4b9f0466a8e094d Apr 14 10:46:10 user devstack@n-api.service[61841]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1881116553-project-member Apr 14 10:46:10 user devstack@n-api.service[61841]: method: > Apr 14 10:46:10 user devstack@n-api.service[61841]: exception: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. Apr 14 10:46:10 user devstack@n-api.service[61841]: action_args: {'id': 'ec16b4bc-5385-4eea-856f-710d52d0261d'} Apr 14 10:46:10 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. Apr 14 10:46:10 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:10 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-8c991406-c914-42aa-a91c-55743f1418f5 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Returning 404 to user: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:46:10 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-8c991406-c914-42aa-a91c-55743f1418f5 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d" status: 404 len: 111 microversion: 2.1 time: 0.034410 Apr 14 10:46:10 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 91/261] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:46:10 2023] GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:46:10 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-0fd83839-c5ec-4b86-baf3-9fb2b6f8bd74 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Calling method '.version_select at 0x7fcd1d28d1b0>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:10 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:10 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:10 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-0fd83839-c5ec-4b86-baf3-9fb2b6f8bd74 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306588747" status: 202 len: 0 microversion: 2.1 time: 0.027706 Apr 14 10:46:10 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 87/262] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 10:46:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306588747 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:46:14 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:14 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-c4ce878e-2e08-4398-a4e3-ae08ddda92a7 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:14 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-c4ce878e-2e08-4398-a4e3-ae08ddda92a7 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c4ce878e-2e08-4398-a4e3-ae08ddda92a7 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c4ce878e-2e08-4398-a4e3-ae08ddda92a7 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c4ce878e-2e08-4398-a4e3-ae08ddda92a7 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c4ce878e-2e08-4398-a4e3-ae08ddda92a7 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c4ce878e-2e08-4398-a4e3-ae08ddda92a7 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c4ce878e-2e08-4398-a4e3-ae08ddda92a7 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-c4ce878e-2e08-4398-a4e3-ae08ddda92a7 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] HTTP exception thrown: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. Apr 14 10:46:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-c4ce878e-2e08-4398-a4e3-ae08ddda92a7 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Request method failure captured: Apr 14 10:46:14 user devstack@n-api.service[61839]: request: DELETE /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d HTTP/1.1 Apr 14 10:46:14 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:46:14 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:46:14 user devstack@n-api.service[61839]: Connection: close Apr 14 10:46:14 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:46:14 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:46:14 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:46:14 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:46:14 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:46:14 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS4i7_opf6MPYr8ScaFK0UUSjedW4Z8a2x1pg2de8HlIawwyrM9_92cB18DW6V6gDItVJ7CvgmKPS0mkB5_7iNoRD7XnAjIGL_ZxwulmZB6HLnRIkPi8p8KyACTX2SrMFytOQ4MdvwWKLvgyn2WXxt2_8gwdmtbVZodjI4inf8Ex7Xo Apr 14 10:46:14 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:46:14 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:46:14 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:46:14 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:46:14 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:46:14 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:46:14 user devstack@n-api.service[61839]: X-Project-Id: 77068eae4fa9459fbe81026615d0c16d Apr 14 10:46:14 user devstack@n-api.service[61839]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1881116553 Apr 14 10:46:14 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:46:14 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:46:14 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77068eae4fa9459fbe81026615d0c16d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/77068eae4fa9459fbe81026615d0c16d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77068eae4fa9459fbe81026615d0c16d"}]}] Apr 14 10:46:14 user devstack@n-api.service[61839]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1881116553 Apr 14 10:46:14 user devstack@n-api.service[61839]: X-Tenant-Id: 77068eae4fa9459fbe81026615d0c16d Apr 14 10:46:14 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1881116553 Apr 14 10:46:14 user devstack@n-api.service[61839]: X-User: tempest-AttachSCSIVolumeTestJSON-1881116553-project-member Apr 14 10:46:14 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:46:14 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:46:14 user devstack@n-api.service[61839]: X-User-Id: 806d72cf0d0f4de3a4b9f0466a8e094d Apr 14 10:46:14 user devstack@n-api.service[61839]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1881116553-project-member Apr 14 10:46:14 user devstack@n-api.service[61839]: method: > Apr 14 10:46:14 user devstack@n-api.service[61839]: exception: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. Apr 14 10:46:14 user devstack@n-api.service[61839]: action_args: {'id': 'ec16b4bc-5385-4eea-856f-710d52d0261d'} Apr 14 10:46:14 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. Apr 14 10:46:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:46:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-c4ce878e-2e08-4398-a4e3-ae08ddda92a7 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Returning 404 to user: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:46:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-c4ce878e-2e08-4398-a4e3-ae08ddda92a7 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d" status: 404 len: 111 microversion: 2.1 time: 0.037635 Apr 14 10:46:14 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 85/263] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:46:14 2023] DELETE /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:46:14 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-ecc6a11d-2004-45a3-9d09-7fd1e2568d13 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:14 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-ecc6a11d-2004-45a3-9d09-7fd1e2568d13 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ecc6a11d-2004-45a3-9d09-7fd1e2568d13 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ecc6a11d-2004-45a3-9d09-7fd1e2568d13 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ecc6a11d-2004-45a3-9d09-7fd1e2568d13 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ecc6a11d-2004-45a3-9d09-7fd1e2568d13 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ecc6a11d-2004-45a3-9d09-7fd1e2568d13 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ecc6a11d-2004-45a3-9d09-7fd1e2568d13 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:14 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-ecc6a11d-2004-45a3-9d09-7fd1e2568d13 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] HTTP exception thrown: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. Apr 14 10:46:14 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-ecc6a11d-2004-45a3-9d09-7fd1e2568d13 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Request method failure captured: Apr 14 10:46:14 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d HTTP/1.1 Apr 14 10:46:14 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:46:14 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:46:14 user devstack@n-api.service[61841]: Connection: close Apr 14 10:46:14 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 10:46:14 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:46:14 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:46:14 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:46:14 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:46:14 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4i7_opf6MPYr8ScaFK0UUSjedW4Z8a2x1pg2de8HlIawwyrM9_92cB18DW6V6gDItVJ7CvgmKPS0mkB5_7iNoRD7XnAjIGL_ZxwulmZB6HLnRIkPi8p8KyACTX2SrMFytOQ4MdvwWKLvgyn2WXxt2_8gwdmtbVZodjI4inf8Ex7Xo Apr 14 10:46:14 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:46:14 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:46:14 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:46:14 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:46:14 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:46:14 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:46:14 user devstack@n-api.service[61841]: X-Project-Id: 77068eae4fa9459fbe81026615d0c16d Apr 14 10:46:14 user devstack@n-api.service[61841]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1881116553 Apr 14 10:46:14 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:46:14 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:46:14 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77068eae4fa9459fbe81026615d0c16d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/77068eae4fa9459fbe81026615d0c16d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/77068eae4fa9459fbe81026615d0c16d"}]}] Apr 14 10:46:14 user devstack@n-api.service[61841]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1881116553 Apr 14 10:46:14 user devstack@n-api.service[61841]: X-Tenant-Id: 77068eae4fa9459fbe81026615d0c16d Apr 14 10:46:14 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1881116553 Apr 14 10:46:14 user devstack@n-api.service[61841]: X-User: tempest-AttachSCSIVolumeTestJSON-1881116553-project-member Apr 14 10:46:14 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:46:14 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:46:14 user devstack@n-api.service[61841]: X-User-Id: 806d72cf0d0f4de3a4b9f0466a8e094d Apr 14 10:46:14 user devstack@n-api.service[61841]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1881116553-project-member Apr 14 10:46:14 user devstack@n-api.service[61841]: method: > Apr 14 10:46:14 user devstack@n-api.service[61841]: exception: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. Apr 14 10:46:14 user devstack@n-api.service[61841]: action_args: {'id': 'ec16b4bc-5385-4eea-856f-710d52d0261d'} Apr 14 10:46:14 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. Apr 14 10:46:14 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:14 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-ecc6a11d-2004-45a3-9d09-7fd1e2568d13 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Returning 404 to user: Instance ec16b4bc-5385-4eea-856f-710d52d0261d could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:46:14 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-ecc6a11d-2004-45a3-9d09-7fd1e2568d13 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d" status: 404 len: 111 microversion: 2.1 time: 0.038629 Apr 14 10:46:14 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 92/264] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:46:14 2023] GET /compute/v2.1/servers/ec16b4bc-5385-4eea-856f-710d52d0261d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:46:17 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:17 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:17 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:17 user devstack@n-api.service[61840]: DEBUG nova.objects.instance [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'services' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=61840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:46:17 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments/3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75" status: 202 len: 0 microversion: 2.1 time: 0.164051 Apr 14 10:46:17 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 88/265] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:46:17 2023] DELETE /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments/3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:46:17 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-27c0c81f-bbbd-476b-bea8-f1e67f54d57f tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:17 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-27c0c81f-bbbd-476b-bea8-f1e67f54d57f tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-27c0c81f-bbbd-476b-bea8-f1e67f54d57f tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-27c0c81f-bbbd-476b-bea8-f1e67f54d57f tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-27c0c81f-bbbd-476b-bea8-f1e67f54d57f tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-27c0c81f-bbbd-476b-bea8-f1e67f54d57f tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-27c0c81f-bbbd-476b-bea8-f1e67f54d57f tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-27c0c81f-bbbd-476b-bea8-f1e67f54d57f tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:17 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-27c0c81f-bbbd-476b-bea8-f1e67f54d57f tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051625 Apr 14 10:46:17 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 86/266] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:46:17 2023] GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-89ab0fd0-5867-4a02-b8ed-926eb6fd254e tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-89ab0fd0-5867-4a02-b8ed-926eb6fd254e tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-89ab0fd0-5867-4a02-b8ed-926eb6fd254e tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-89ab0fd0-5867-4a02-b8ed-926eb6fd254e tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-89ab0fd0-5867-4a02-b8ed-926eb6fd254e tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-89ab0fd0-5867-4a02-b8ed-926eb6fd254e tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-89ab0fd0-5867-4a02-b8ed-926eb6fd254e tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-89ab0fd0-5867-4a02-b8ed-926eb6fd254e tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:18 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-89ab0fd0-5867-4a02-b8ed-926eb6fd254e tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-instance-actions/req-2c6010cc-acf5-4276-98a6-acab32d6c4da" status: 200 len: 503 microversion: 2.49 time: 0.046117 Apr 14 10:46:18 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 93/267] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 10:46:18 2023] GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-instance-actions/req-2c6010cc-acf5-4276-98a6-acab32d6c4da => generated 503 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ca99513a-2e9b-4986-8ee8-0c4f60cf2f51 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-ca99513a-2e9b-4986-8ee8-0c4f60cf2f51 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ca99513a-2e9b-4986-8ee8-0c4f60cf2f51 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ca99513a-2e9b-4986-8ee8-0c4f60cf2f51 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ca99513a-2e9b-4986-8ee8-0c4f60cf2f51 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ca99513a-2e9b-4986-8ee8-0c4f60cf2f51 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ca99513a-2e9b-4986-8ee8-0c4f60cf2f51 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ca99513a-2e9b-4986-8ee8-0c4f60cf2f51 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-ca99513a-2e9b-4986-8ee8-0c4f60cf2f51 tempest-TaggedAttachmentsTest-1404016169 tempest-TaggedAttachmentsTest-1404016169-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-instance-actions/req-2c6010cc-acf5-4276-98a6-acab32d6c4da" status: 200 len: 503 microversion: 2.49 time: 0.114770 Apr 14 10:46:18 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 89/268] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 10:46:18 2023] GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-instance-actions/req-2c6010cc-acf5-4276-98a6-acab32d6c4da => generated 503 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:46:18 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8357df06-41bc-47ab-9460-0210a4b6983c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:18 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-8357df06-41bc-47ab-9460-0210a4b6983c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8357df06-41bc-47ab-9460-0210a4b6983c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8357df06-41bc-47ab-9460-0210a4b6983c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8357df06-41bc-47ab-9460-0210a4b6983c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8357df06-41bc-47ab-9460-0210a4b6983c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8357df06-41bc-47ab-9460-0210a4b6983c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8357df06-41bc-47ab-9460-0210a4b6983c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:18 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-8357df06-41bc-47ab-9460-0210a4b6983c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.047861 Apr 14 10:46:18 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 87/269] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 10:46:18 2023] GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:18 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:46:18 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d" status: 204 len: 0 microversion: 2.49 time: 0.114168 Apr 14 10:46:18 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 94/270] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 10:46:18 2023] DELETE /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-6d883903-5f34-4104-9402-974955b64825 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-6d883903-5f34-4104-9402-974955b64825 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6d883903-5f34-4104-9402-974955b64825 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6d883903-5f34-4104-9402-974955b64825 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6d883903-5f34-4104-9402-974955b64825 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6d883903-5f34-4104-9402-974955b64825 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6d883903-5f34-4104-9402-974955b64825 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6d883903-5f34-4104-9402-974955b64825 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:19 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-6d883903-5f34-4104-9402-974955b64825 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ce31180e5946d4a027ae6ac9d136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8cdf0a5d7f49a9897167eb79dbfc39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:19 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-6d883903-5f34-4104-9402-974955b64825 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c7ce31180e5946d4a027ae6ac9d136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8cdf0a5d7f49a9897167eb79dbfc39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:19 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-6d883903-5f34-4104-9402-974955b64825 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c7ce31180e5946d4a027ae6ac9d136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8cdf0a5d7f49a9897167eb79dbfc39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:19 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-6d883903-5f34-4104-9402-974955b64825 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d" status: 200 len: 1752 microversion: 2.49 time: 0.259995 Apr 14 10:46:19 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 90/271] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:46:18 2023] GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d => generated 1752 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:46:19 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-8f39d43d-485e-4831-837a-fff5f63d4437 req-26dc5944-e468-416c-baa8-e7eafff05145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f6ad8c-40d3-4b6e-af07-4848fafc431d", "name": "network-vif-unplugged", "status": "completed", "tag": "edef0af3-01e9-4008-9017-119519f73981"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8f39d43d-485e-4831-837a-fff5f63d4437 req-26dc5944-e468-416c-baa8-e7eafff05145 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8f39d43d-485e-4831-837a-fff5f63d4437 req-26dc5944-e468-416c-baa8-e7eafff05145 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8f39d43d-485e-4831-837a-fff5f63d4437 req-26dc5944-e468-416c-baa8-e7eafff05145 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:19 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-8f39d43d-485e-4831-837a-fff5f63d4437 req-26dc5944-e468-416c-baa8-e7eafff05145 service nova] Creating event network-vif-unplugged:edef0af3-01e9-4008-9017-119519f73981 for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d on user Apr 14 10:46:19 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-8f39d43d-485e-4831-837a-fff5f63d4437 req-26dc5944-e468-416c-baa8-e7eafff05145 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081981 Apr 14 10:46:19 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 88/272] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-fae5af27-ffbf-491e-93b9-4cabed0f64cf req-b241344e-a4e1-472b-8702-a85d5e322dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f6ad8c-40d3-4b6e-af07-4848fafc431d", "name": "network-vif-deleted", "tag": "edef0af3-01e9-4008-9017-119519f73981"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-fae5af27-ffbf-491e-93b9-4cabed0f64cf req-b241344e-a4e1-472b-8702-a85d5e322dd8 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-fae5af27-ffbf-491e-93b9-4cabed0f64cf req-b241344e-a4e1-472b-8702-a85d5e322dd8 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-fae5af27-ffbf-491e-93b9-4cabed0f64cf req-b241344e-a4e1-472b-8702-a85d5e322dd8 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:21 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-fae5af27-ffbf-491e-93b9-4cabed0f64cf req-b241344e-a4e1-472b-8702-a85d5e322dd8 service nova] Creating event network-vif-deleted:edef0af3-01e9-4008-9017-119519f73981 for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d on user Apr 14 10:46:21 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-fae5af27-ffbf-491e-93b9-4cabed0f64cf req-b241344e-a4e1-472b-8702-a85d5e322dd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036383 Apr 14 10:46:21 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 95/273] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-6d2f21ec-8d74-4735-bdc7-743490d107e0 req-b13bfdd0-8dcc-4b9d-ae82-d385782b4fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f6ad8c-40d3-4b6e-af07-4848fafc431d", "name": "network-vif-plugged", "status": "completed", "tag": "edef0af3-01e9-4008-9017-119519f73981"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6d2f21ec-8d74-4735-bdc7-743490d107e0 req-b13bfdd0-8dcc-4b9d-ae82-d385782b4fe6 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6d2f21ec-8d74-4735-bdc7-743490d107e0 req-b13bfdd0-8dcc-4b9d-ae82-d385782b4fe6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6d2f21ec-8d74-4735-bdc7-743490d107e0 req-b13bfdd0-8dcc-4b9d-ae82-d385782b4fe6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:21 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-6d2f21ec-8d74-4735-bdc7-743490d107e0 req-b13bfdd0-8dcc-4b9d-ae82-d385782b4fe6 service nova] Creating event network-vif-plugged:edef0af3-01e9-4008-9017-119519f73981 for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d on user Apr 14 10:46:21 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-6d2f21ec-8d74-4735-bdc7-743490d107e0 req-b13bfdd0-8dcc-4b9d-ae82-d385782b4fe6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033978 Apr 14 10:46:21 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 91/274] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-e6875a29-fa4d-4a52-94f5-f3aadf8e6b6b tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:21 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-e6875a29-fa4d-4a52-94f5-f3aadf8e6b6b tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e6875a29-fa4d-4a52-94f5-f3aadf8e6b6b tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e6875a29-fa4d-4a52-94f5-f3aadf8e6b6b tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e6875a29-fa4d-4a52-94f5-f3aadf8e6b6b tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e6875a29-fa4d-4a52-94f5-f3aadf8e6b6b tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e6875a29-fa4d-4a52-94f5-f3aadf8e6b6b tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e6875a29-fa4d-4a52-94f5-f3aadf8e6b6b tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:21 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-e6875a29-fa4d-4a52-94f5-f3aadf8e6b6b tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] HTTP exception thrown: Instance c0e2af6d-3694-4166-a3d0-b5be1107c488 could not be found. Apr 14 10:46:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-e6875a29-fa4d-4a52-94f5-f3aadf8e6b6b tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Request method failure captured: Apr 14 10:46:21 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/c0e2af6d-3694-4166-a3d0-b5be1107c488 HTTP/1.1 Apr 14 10:46:21 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:46:21 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:46:21 user devstack@n-api.service[61839]: Connection: close Apr 14 10:46:21 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:46:21 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:46:21 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:46:21 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:46:21 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:46:21 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS5YG_zorvQx-WrRx1UiH2WyrHE9WFA9xG_rOszmmkjLxd-Egh5Gr9HbG5Wv6VQvcnEs_wJKpcNZDP63MVyVqRcVKOh0BMhJ4rrWB3edQuDe2YlzNem96lMUv3eIjFth0rCkEvHdkob0AvI1wEAqh7ObBU0iPeUxFu4evy9KxE-0Sao Apr 14 10:46:21 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:46:21 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:46:21 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:46:21 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:46:21 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:46:21 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:46:21 user devstack@n-api.service[61839]: X-Project-Id: 78792d5e25ef4c7aa31b0656dacdd9f4 Apr 14 10:46:21 user devstack@n-api.service[61839]: X-Project-Name: tempest-VolumesNegativeTest-1757520579 Apr 14 10:46:21 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:46:21 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:46:21 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/78792d5e25ef4c7aa31b0656dacdd9f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/78792d5e25ef4c7aa31b0656dacdd9f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/78792d5e25ef4c7aa31b0656dacdd9f4"}]}] Apr 14 10:46:21 user devstack@n-api.service[61839]: X-Tenant: tempest-VolumesNegativeTest-1757520579 Apr 14 10:46:21 user devstack@n-api.service[61839]: X-Tenant-Id: 78792d5e25ef4c7aa31b0656dacdd9f4 Apr 14 10:46:21 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-VolumesNegativeTest-1757520579 Apr 14 10:46:21 user devstack@n-api.service[61839]: X-User: tempest-VolumesNegativeTest-1757520579-project-member Apr 14 10:46:21 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:46:21 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:46:21 user devstack@n-api.service[61839]: X-User-Id: 187b7b3152ef496cbd84a94232d5ada5 Apr 14 10:46:21 user devstack@n-api.service[61839]: X-User-Name: tempest-VolumesNegativeTest-1757520579-project-member Apr 14 10:46:21 user devstack@n-api.service[61839]: method: > Apr 14 10:46:21 user devstack@n-api.service[61839]: exception: Instance c0e2af6d-3694-4166-a3d0-b5be1107c488 could not be found. Apr 14 10:46:21 user devstack@n-api.service[61839]: action_args: {'id': 'c0e2af6d-3694-4166-a3d0-b5be1107c488'} Apr 14 10:46:21 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e2af6d-3694-4166-a3d0-b5be1107c488 could not be found. Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e2af6d-3694-4166-a3d0-b5be1107c488 could not be found. Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e2af6d-3694-4166-a3d0-b5be1107c488 could not be found. Apr 14 10:46:21 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:46:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-e6875a29-fa4d-4a52-94f5-f3aadf8e6b6b tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Returning 404 to user: Instance c0e2af6d-3694-4166-a3d0-b5be1107c488 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:46:21 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-e6875a29-fa4d-4a52-94f5-f3aadf8e6b6b tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c0e2af6d-3694-4166-a3d0-b5be1107c488" status: 404 len: 111 microversion: 2.1 time: 0.033806 Apr 14 10:46:21 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 89/275] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:46:21 2023] GET /compute/v2.1/servers/c0e2af6d-3694-4166-a3d0-b5be1107c488 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 10:46:24 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-8bc35a39-a65b-44a1-ab26-239ddb6151ef tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:24 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-8bc35a39-a65b-44a1-ab26-239ddb6151ef tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8bc35a39-a65b-44a1-ab26-239ddb6151ef tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8bc35a39-a65b-44a1-ab26-239ddb6151ef tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8bc35a39-a65b-44a1-ab26-239ddb6151ef tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8bc35a39-a65b-44a1-ab26-239ddb6151ef tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8bc35a39-a65b-44a1-ab26-239ddb6151ef tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8bc35a39-a65b-44a1-ab26-239ddb6151ef tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:24 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-8bc35a39-a65b-44a1-ab26-239ddb6151ef tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:24 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-8bc35a39-a65b-44a1-ab26-239ddb6151ef tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade" status: 200 len: 1503 microversion: 2.1 time: 0.180579 Apr 14 10:46:24 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 96/276] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:46:24 2023] GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-917884205", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "networks": [{"uuid": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8"}]}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:29 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-d84fb0fe-8a23-4bc4-9984-7890ea64dd03 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:29 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-d84fb0fe-8a23-4bc4-9984-7890ea64dd03 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d84fb0fe-8a23-4bc4-9984-7890ea64dd03 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d84fb0fe-8a23-4bc4-9984-7890ea64dd03 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d84fb0fe-8a23-4bc4-9984-7890ea64dd03 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d84fb0fe-8a23-4bc4-9984-7890ea64dd03 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d84fb0fe-8a23-4bc4-9984-7890ea64dd03 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d84fb0fe-8a23-4bc4-9984-7890ea64dd03 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] validate_networks() for [('07f1f39e-292a-4e73-b4ed-99e5799d6fa8', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:46:29 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-d84fb0fe-8a23-4bc4-9984-7890ea64dd03 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c4ab86a8d244c4be5889b4ac47561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e1e1695464eb5ad8a8c881cf24611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:29 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-d84fb0fe-8a23-4bc4-9984-7890ea64dd03 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606" status: 200 len: 1498 microversion: 2.1 time: 0.231351 Apr 14 10:46:29 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 90/277] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:46:29 2023] GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606 => generated 1498 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting quotas for project 71289f80a05141f482cb538dac3d7b38. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting quotas for user 395bc9d7007c4e01ac7effd418bcea19 and project 71289f80a05141f482cb538dac3d7b38. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:46:29 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:46:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.689140 Apr 14 10:46:29 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 92/278] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 10:46:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 10:46:29 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9544f203-b5da-4d94-8502-15e98550b275 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:29 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-9544f203-b5da-4d94-8502-15e98550b275 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:29 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-9544f203-b5da-4d94-8502-15e98550b275 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:29 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-9544f203-b5da-4d94-8502-15e98550b275 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:29 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-9544f203-b5da-4d94-8502-15e98550b275 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:29 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-9544f203-b5da-4d94-8502-15e98550b275 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07" status: 200 len: 1394 microversion: 2.87 time: 0.077720 Apr 14 10:46:29 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 97/279] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:46:29 2023] GET /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07 => generated 1394 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:46:32 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-2c2ad35f-f050-49a3-ace5-9300827f0de4 req-e0fbd520-5958-494b-bad2-cf711aacf6be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e479154a-acd6-47aa-9a5b-43c6e0feda07", "tag": "2fbfd894-8e16-4039-b726-638e802602c5"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2c2ad35f-f050-49a3-ace5-9300827f0de4 req-e0fbd520-5958-494b-bad2-cf711aacf6be service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2c2ad35f-f050-49a3-ace5-9300827f0de4 req-e0fbd520-5958-494b-bad2-cf711aacf6be service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2c2ad35f-f050-49a3-ace5-9300827f0de4 req-e0fbd520-5958-494b-bad2-cf711aacf6be service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:32 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-2c2ad35f-f050-49a3-ace5-9300827f0de4 req-e0fbd520-5958-494b-bad2-cf711aacf6be service nova] Creating event network-changed:2fbfd894-8e16-4039-b726-638e802602c5 for instance e479154a-acd6-47aa-9a5b-43c6e0feda07 on user Apr 14 10:46:32 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-2c2ad35f-f050-49a3-ace5-9300827f0de4 req-e0fbd520-5958-494b-bad2-cf711aacf6be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030084 Apr 14 10:46:32 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 91/280] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:35 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-f582fa09-1e92-4418-bf0c-c4d3604665e4 req-07c5554d-443e-4f18-9e90-2c6617bee834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e479154a-acd6-47aa-9a5b-43c6e0feda07", "name": "network-vif-plugged", "status": "completed", "tag": "2fbfd894-8e16-4039-b726-638e802602c5"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f582fa09-1e92-4418-bf0c-c4d3604665e4 req-07c5554d-443e-4f18-9e90-2c6617bee834 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f582fa09-1e92-4418-bf0c-c4d3604665e4 req-07c5554d-443e-4f18-9e90-2c6617bee834 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f582fa09-1e92-4418-bf0c-c4d3604665e4 req-07c5554d-443e-4f18-9e90-2c6617bee834 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:35 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-f582fa09-1e92-4418-bf0c-c4d3604665e4 req-07c5554d-443e-4f18-9e90-2c6617bee834 service nova] Creating event network-vif-plugged:2fbfd894-8e16-4039-b726-638e802602c5 for instance e479154a-acd6-47aa-9a5b-43c6e0feda07 on user Apr 14 10:46:35 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-f582fa09-1e92-4418-bf0c-c4d3604665e4 req-07c5554d-443e-4f18-9e90-2c6617bee834 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059145 Apr 14 10:46:35 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 93/281] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-818c96e0-8855-478a-94b5-3b9a62a56d71 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-818c96e0-8855-478a-94b5-3b9a62a56d71 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-818c96e0-8855-478a-94b5-3b9a62a56d71 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-818c96e0-8855-478a-94b5-3b9a62a56d71 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-818c96e0-8855-478a-94b5-3b9a62a56d71 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-818c96e0-8855-478a-94b5-3b9a62a56d71 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-818c96e0-8855-478a-94b5-3b9a62a56d71 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-818c96e0-8855-478a-94b5-3b9a62a56d71 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.077s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:36 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-818c96e0-8855-478a-94b5-3b9a62a56d71 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] HTTP exception thrown: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-818c96e0-8855-478a-94b5-3b9a62a56d71 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Request method failure captured: Apr 14 10:46:36 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca HTTP/1.1 Apr 14 10:46:36 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:46:36 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:46:36 user devstack@n-api.service[61841]: Connection: close Apr 14 10:46:36 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 10:46:36 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:46:36 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:46:36 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:46:36 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4d6738UxaVeIzo5rS_RWQ2D9PktK_f5pZ7BQHyXm-WeZHUzGUUqzHVsZDpMTlToyVB0tD0xrvwkymnlShjF3QGI-1t23NKo344IGxkaPE0oQTQdxMuLj05EGInFV8JcnscrXLJ5965p2btbsXKOlV1uyZQVR8qS6YONEtCirHFdto Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Project-Id: f701119cef78433280cbddf2adf685db Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1078203530 Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f701119cef78433280cbddf2adf685db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f701119cef78433280cbddf2adf685db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f701119cef78433280cbddf2adf685db"}]}] Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1078203530 Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Tenant-Id: f701119cef78433280cbddf2adf685db Apr 14 10:46:36 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1078203530 Apr 14 10:46:36 user devstack@n-api.service[61841]: X-User: tempest-TaggedBootDevicesTest_v242-1078203530-project-member Apr 14 10:46:36 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:46:36 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:46:36 user devstack@n-api.service[61841]: X-User-Id: 3579ac20f8094f5a9fbd036ed05cda23 Apr 14 10:46:36 user devstack@n-api.service[61841]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1078203530-project-member Apr 14 10:46:36 user devstack@n-api.service[61841]: method: > Apr 14 10:46:36 user devstack@n-api.service[61841]: exception: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. Apr 14 10:46:36 user devstack@n-api.service[61841]: action_args: {'id': 'a81da242-e8d8-4b41-b84a-e12d603823ca'} Apr 14 10:46:36 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. Apr 14 10:46:36 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-818c96e0-8855-478a-94b5-3b9a62a56d71 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Returning 404 to user: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:46:36 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-818c96e0-8855-478a-94b5-3b9a62a56d71 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca" status: 404 len: 111 microversion: 2.42 time: 0.123809 Apr 14 10:46:36 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 98/282] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:46:36 2023] GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:46:36 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-40f86d21-c275-4c3e-b0e4-6686272f800b tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Calling method '.version_select at 0x7fcd1d2993f0>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:36 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-40f86d21-c275-4c3e-b0e4-6686272f800b tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-190287482" status: 204 len: 0 microversion: 2.42 time: 0.029797 Apr 14 10:46:36 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 92/283] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 10:46:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-190287482 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 10:46:36 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-b311d77e-e001-43cf-b78a-fdc39a290df4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:36 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-b311d77e-e001-43cf-b78a-fdc39a290df4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b311d77e-e001-43cf-b78a-fdc39a290df4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b311d77e-e001-43cf-b78a-fdc39a290df4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b311d77e-e001-43cf-b78a-fdc39a290df4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b311d77e-e001-43cf-b78a-fdc39a290df4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b311d77e-e001-43cf-b78a-fdc39a290df4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b311d77e-e001-43cf-b78a-fdc39a290df4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:36 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-b311d77e-e001-43cf-b78a-fdc39a290df4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:36 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-b311d77e-e001-43cf-b78a-fdc39a290df4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1657 microversion: 2.1 time: 0.282302 Apr 14 10:46:36 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 94/284] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:46:36 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1657 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:37 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-f677886d-07b5-4365-b798-bd840c9d5600 req-16a407d9-42c3-4646-9bd9-9b3393cf51ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e479154a-acd6-47aa-9a5b-43c6e0feda07", "name": "network-vif-plugged", "status": "completed", "tag": "2fbfd894-8e16-4039-b726-638e802602c5"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:37 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f677886d-07b5-4365-b798-bd840c9d5600 req-16a407d9-42c3-4646-9bd9-9b3393cf51ad service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:37 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f677886d-07b5-4365-b798-bd840c9d5600 req-16a407d9-42c3-4646-9bd9-9b3393cf51ad service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:37 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f677886d-07b5-4365-b798-bd840c9d5600 req-16a407d9-42c3-4646-9bd9-9b3393cf51ad service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:37 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-f677886d-07b5-4365-b798-bd840c9d5600 req-16a407d9-42c3-4646-9bd9-9b3393cf51ad service nova] Creating event network-vif-plugged:2fbfd894-8e16-4039-b726-638e802602c5 for instance e479154a-acd6-47aa-9a5b-43c6e0feda07 on user Apr 14 10:46:37 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-f677886d-07b5-4365-b798-bd840c9d5600 req-16a407d9-42c3-4646-9bd9-9b3393cf51ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045870 Apr 14 10:46:37 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 93/285] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:37 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.395486 Apr 14 10:46:37 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 99/286] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:46:36 2023] POST /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/os-volume_attachments => generated 194 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d5f27fe9-6d94-406f-989c-d2285cca5712 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:40 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-d5f27fe9-6d94-406f-989c-d2285cca5712 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:40 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:40 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d5f27fe9-6d94-406f-989c-d2285cca5712 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d5f27fe9-6d94-406f-989c-d2285cca5712 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d5f27fe9-6d94-406f-989c-d2285cca5712 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d5f27fe9-6d94-406f-989c-d2285cca5712 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d5f27fe9-6d94-406f-989c-d2285cca5712 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d5f27fe9-6d94-406f-989c-d2285cca5712 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-91433051-1680-4bf8-bd74-422928d09f93 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-91433051-1680-4bf8-bd74-422928d09f93 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91433051-1680-4bf8-bd74-422928d09f93 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91433051-1680-4bf8-bd74-422928d09f93 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91433051-1680-4bf8-bd74-422928d09f93 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91433051-1680-4bf8-bd74-422928d09f93 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91433051-1680-4bf8-bd74-422928d09f93 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91433051-1680-4bf8-bd74-422928d09f93 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-5bf72554-199b-4081-ad9f-710a0e8e6e89 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-5bf72554-199b-4081-ad9f-710a0e8e6e89 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5bf72554-199b-4081-ad9f-710a0e8e6e89 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5bf72554-199b-4081-ad9f-710a0e8e6e89 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5bf72554-199b-4081-ad9f-710a0e8e6e89 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5bf72554-199b-4081-ad9f-710a0e8e6e89 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5bf72554-199b-4081-ad9f-710a0e8e6e89 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5bf72554-199b-4081-ad9f-710a0e8e6e89 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:40 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-91433051-1680-4bf8-bd74-422928d09f93 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062775 Apr 14 10:46:40 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 94/287] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:46:40 2023] GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:46:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-5bf72554-199b-4081-ad9f-710a0e8e6e89 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] HTTP exception thrown: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-5bf72554-199b-4081-ad9f-710a0e8e6e89 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Request method failure captured: Apr 14 10:46:40 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e HTTP/1.1 Apr 14 10:46:40 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:46:40 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:46:40 user devstack@n-api.service[61841]: Connection: close Apr 14 10:46:40 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 10:46:40 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:46:40 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:46:40 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:46:40 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4ZTYo2t3gzV6wzcCjvZVKS1u7WvBJiBiUSW6K_72T-ROrxIDwhNSu8mka54GB9kRDeow9f3aHDiEy6MKt3LjwPqEGrnD-jbFmM8yoK5EO8Dfv9U_TWCR8DKyHY4uIZn9hnFcQmjsTvBf898-hKDMP8Bf7m6eAROD3WNcEKgranrwg Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Project-Id: 0e024f5a578e4543a02c6adc7d456f39 Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Project-Name: tempest-TaggedBootDevicesTest-656117710 Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e024f5a578e4543a02c6adc7d456f39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0e024f5a578e4543a02c6adc7d456f39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e024f5a578e4543a02c6adc7d456f39"}]}] Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Tenant: tempest-TaggedBootDevicesTest-656117710 Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Tenant-Id: 0e024f5a578e4543a02c6adc7d456f39 Apr 14 10:46:40 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-TaggedBootDevicesTest-656117710 Apr 14 10:46:40 user devstack@n-api.service[61841]: X-User: tempest-TaggedBootDevicesTest-656117710-project-member Apr 14 10:46:40 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:46:40 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:46:40 user devstack@n-api.service[61841]: X-User-Id: 1f6dac34303f4965babaee39bb363b5e Apr 14 10:46:40 user devstack@n-api.service[61841]: X-User-Name: tempest-TaggedBootDevicesTest-656117710-project-member Apr 14 10:46:40 user devstack@n-api.service[61841]: method: > Apr 14 10:46:40 user devstack@n-api.service[61841]: exception: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. Apr 14 10:46:40 user devstack@n-api.service[61841]: action_args: {'id': 'd1516acc-354e-41f6-a639-61dea870b11e'} Apr 14 10:46:40 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. Apr 14 10:46:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-5bf72554-199b-4081-ad9f-710a0e8e6e89 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Returning 404 to user: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:46:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-5bf72554-199b-4081-ad9f-710a0e8e6e89 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e" status: 404 len: 111 microversion: 2.32 time: 0.057799 Apr 14 10:46:40 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 100/288] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:46:40 2023] GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-508dd5e9-6f0e-4ff2-85fd-5ca87196701a tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Calling method '.version_select at 0x7fcd1d299ab0>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:40 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-508dd5e9-6f0e-4ff2-85fd-5ca87196701a tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1957800049" status: 204 len: 0 microversion: 2.32 time: 0.037099 Apr 14 10:46:40 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 95/289] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 10:46:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1957800049 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 10:46:40 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-d5f27fe9-6d94-406f-989c-d2285cca5712 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7212c3fe50ef465c99a0eefec4cbd753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482809b9148e408b84b156802a21a225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d5f27fe9-6d94-406f-989c-d2285cca5712 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce" status: 200 len: 1671 microversion: 2.1 time: 0.510721 Apr 14 10:46:40 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 95/290] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:46:40 2023] GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce => generated 1671 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:40 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:46:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564" status: 204 len: 0 microversion: 2.1 time: 0.215226 Apr 14 10:46:40 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 101/291] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:46:40 2023] DELETE /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-a525cfa4-544c-4c9d-b95c-44acd87983b9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-a525cfa4-544c-4c9d-b95c-44acd87983b9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a525cfa4-544c-4c9d-b95c-44acd87983b9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a525cfa4-544c-4c9d-b95c-44acd87983b9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a525cfa4-544c-4c9d-b95c-44acd87983b9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a525cfa4-544c-4c9d-b95c-44acd87983b9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a525cfa4-544c-4c9d-b95c-44acd87983b9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a525cfa4-544c-4c9d-b95c-44acd87983b9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:41 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-73f2a669-f53d-43d3-a901-808ba312b62c req-7746828d-8b3d-4836-9ce0-33d5c52fdc09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f539d8-4144-467b-ac69-44011c5b3564", "name": "network-vif-unplugged", "status": "completed", "tag": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-73f2a669-f53d-43d3-a901-808ba312b62c req-7746828d-8b3d-4836-9ce0-33d5c52fdc09 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-73f2a669-f53d-43d3-a901-808ba312b62c req-7746828d-8b3d-4836-9ce0-33d5c52fdc09 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-73f2a669-f53d-43d3-a901-808ba312b62c req-7746828d-8b3d-4836-9ce0-33d5c52fdc09 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-73f2a669-f53d-43d3-a901-808ba312b62c req-7746828d-8b3d-4836-9ce0-33d5c52fdc09 service nova] Creating event network-vif-unplugged:d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 for instance d6f539d8-4144-467b-ac69-44011c5b3564 on user Apr 14 10:46:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-73f2a669-f53d-43d3-a901-808ba312b62c req-7746828d-8b3d-4836-9ce0-33d5c52fdc09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032368 Apr 14 10:46:41 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 96/292] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:41 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-7421989d-c552-4e59-8cc0-1174a9342304 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:41 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-7421989d-c552-4e59-8cc0-1174a9342304 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7421989d-c552-4e59-8cc0-1174a9342304 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7421989d-c552-4e59-8cc0-1174a9342304 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7421989d-c552-4e59-8cc0-1174a9342304 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7421989d-c552-4e59-8cc0-1174a9342304 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7421989d-c552-4e59-8cc0-1174a9342304 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7421989d-c552-4e59-8cc0-1174a9342304 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:41 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-7421989d-c552-4e59-8cc0-1174a9342304 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] HTTP exception thrown: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. Apr 14 10:46:41 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-7421989d-c552-4e59-8cc0-1174a9342304 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Request method failure captured: Apr 14 10:46:41 user devstack@n-api.service[61841]: request: DELETE /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca HTTP/1.1 Apr 14 10:46:41 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:46:41 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:46:41 user devstack@n-api.service[61841]: Connection: close Apr 14 10:46:41 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 10:46:41 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:46:41 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:46:41 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:46:41 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4d6738UxaVeIzo5rS_RWQ2D9PktK_f5pZ7BQHyXm-WeZHUzGUUqzHVsZDpMTlToyVB0tD0xrvwkymnlShjF3QGI-1t23NKo344IGxkaPE0oQTQdxMuLj05EGInFV8JcnscrXLJ5965p2btbsXKOlV1uyZQVR8qS6YONEtCirHFdto Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Project-Id: f701119cef78433280cbddf2adf685db Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1078203530 Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f701119cef78433280cbddf2adf685db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f701119cef78433280cbddf2adf685db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f701119cef78433280cbddf2adf685db"}]}] Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1078203530 Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Tenant-Id: f701119cef78433280cbddf2adf685db Apr 14 10:46:41 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1078203530 Apr 14 10:46:41 user devstack@n-api.service[61841]: X-User: tempest-TaggedBootDevicesTest_v242-1078203530-project-member Apr 14 10:46:41 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:46:41 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:46:41 user devstack@n-api.service[61841]: X-User-Id: 3579ac20f8094f5a9fbd036ed05cda23 Apr 14 10:46:41 user devstack@n-api.service[61841]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1078203530-project-member Apr 14 10:46:41 user devstack@n-api.service[61841]: method: > Apr 14 10:46:41 user devstack@n-api.service[61841]: exception: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. Apr 14 10:46:41 user devstack@n-api.service[61841]: action_args: {'id': 'a81da242-e8d8-4b41-b84a-e12d603823ca'} Apr 14 10:46:41 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. Apr 14 10:46:41 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:46:41 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-7421989d-c552-4e59-8cc0-1174a9342304 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Returning 404 to user: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:46:41 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-7421989d-c552-4e59-8cc0-1174a9342304 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca" status: 404 len: 111 microversion: 2.42 time: 0.056755 Apr 14 10:46:41 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 102/293] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 10:46:41 2023] DELETE /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:46:41 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-b410cf48-8527-429d-837d-a9da763fa896 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:41 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-b410cf48-8527-429d-837d-a9da763fa896 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b410cf48-8527-429d-837d-a9da763fa896 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b410cf48-8527-429d-837d-a9da763fa896 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b410cf48-8527-429d-837d-a9da763fa896 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b410cf48-8527-429d-837d-a9da763fa896 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b410cf48-8527-429d-837d-a9da763fa896 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b410cf48-8527-429d-837d-a9da763fa896 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:41 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-a525cfa4-544c-4c9d-b95c-44acd87983b9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15c150540fa4d9c825a9ac81d674308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64094cc814374da59456a39ef9cd8cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:41 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-a525cfa4-544c-4c9d-b95c-44acd87983b9 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564" status: 200 len: 1648 microversion: 2.1 time: 0.532510 Apr 14 10:46:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-b410cf48-8527-429d-837d-a9da763fa896 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] HTTP exception thrown: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. Apr 14 10:46:41 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-b410cf48-8527-429d-837d-a9da763fa896 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Request method failure captured: Apr 14 10:46:41 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca HTTP/1.1 Apr 14 10:46:41 user devstack@n-api.service[61840]: Accept: application/json Apr 14 10:46:41 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 10:46:41 user devstack@n-api.service[61840]: Connection: close Apr 14 10:46:41 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 10:46:41 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 10:46:41 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 10:46:41 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 10:46:41 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS4d6738UxaVeIzo5rS_RWQ2D9PktK_f5pZ7BQHyXm-WeZHUzGUUqzHVsZDpMTlToyVB0tD0xrvwkymnlShjF3QGI-1t23NKo344IGxkaPE0oQTQdxMuLj05EGInFV8JcnscrXLJ5965p2btbsXKOlV1uyZQVR8qS6YONEtCirHFdto Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Project-Id: f701119cef78433280cbddf2adf685db Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1078203530 Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f701119cef78433280cbddf2adf685db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f701119cef78433280cbddf2adf685db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f701119cef78433280cbddf2adf685db"}]}] Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1078203530 Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Tenant-Id: f701119cef78433280cbddf2adf685db Apr 14 10:46:41 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1078203530 Apr 14 10:46:41 user devstack@n-api.service[61840]: X-User: tempest-TaggedBootDevicesTest_v242-1078203530-project-member Apr 14 10:46:41 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 10:46:41 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 10:46:41 user devstack@n-api.service[61840]: X-User-Id: 3579ac20f8094f5a9fbd036ed05cda23 Apr 14 10:46:41 user devstack@n-api.service[61840]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1078203530-project-member Apr 14 10:46:41 user devstack@n-api.service[61840]: method: > Apr 14 10:46:41 user devstack@n-api.service[61840]: exception: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. Apr 14 10:46:41 user devstack@n-api.service[61840]: action_args: {'id': 'a81da242-e8d8-4b41-b84a-e12d603823ca'} Apr 14 10:46:41 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. Apr 14 10:46:41 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:46:41 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-b410cf48-8527-429d-837d-a9da763fa896 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Returning 404 to user: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:46:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-b410cf48-8527-429d-837d-a9da763fa896 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca" status: 404 len: 111 microversion: 2.42 time: 0.030478 Apr 14 10:46:41 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 96/294] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:46:40 2023] GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564 => generated 1648 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:46:41 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 97/295] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:46:41 2023] GET /compute/v2.1/servers/a81da242-e8d8-4b41-b84a-e12d603823ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:46:43 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4116efc6-988f-40cf-af06-2abf9c6cd44a"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:43 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:43 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-a9fcb987-d2e8-4a85-9369-5efd6d61da58 req-6d4961e4-5a8e-40b1-a68e-254b37fa25fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f539d8-4144-467b-ac69-44011c5b3564", "name": "network-vif-plugged", "status": "completed", "tag": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-a9fcb987-d2e8-4a85-9369-5efd6d61da58 req-6d4961e4-5a8e-40b1-a68e-254b37fa25fe service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-a9fcb987-d2e8-4a85-9369-5efd6d61da58 req-6d4961e4-5a8e-40b1-a68e-254b37fa25fe service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-a9fcb987-d2e8-4a85-9369-5efd6d61da58 req-6d4961e4-5a8e-40b1-a68e-254b37fa25fe service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:43 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-a9fcb987-d2e8-4a85-9369-5efd6d61da58 req-6d4961e4-5a8e-40b1-a68e-254b37fa25fe service nova] Creating event network-vif-plugged:d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 for instance d6f539d8-4144-467b-ac69-44011c5b3564 on user Apr 14 10:46:43 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-a9fcb987-d2e8-4a85-9369-5efd6d61da58 req-6d4961e4-5a8e-40b1-a68e-254b37fa25fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034476 Apr 14 10:46:43 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 97/296] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:46:43 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405582 Apr 14 10:46:43 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 103/297] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:46:43 2023] POST /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:46:44 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-92fec789-5cf4-4106-bf86-c0ff131cb64e tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:44 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-92fec789-5cf4-4106-bf86-c0ff131cb64e tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-92fec789-5cf4-4106-bf86-c0ff131cb64e tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-92fec789-5cf4-4106-bf86-c0ff131cb64e tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-92fec789-5cf4-4106-bf86-c0ff131cb64e tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-92fec789-5cf4-4106-bf86-c0ff131cb64e tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-92fec789-5cf4-4106-bf86-c0ff131cb64e tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-92fec789-5cf4-4106-bf86-c0ff131cb64e tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-92fec789-5cf4-4106-bf86-c0ff131cb64e tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] HTTP exception thrown: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. Apr 14 10:46:44 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-92fec789-5cf4-4106-bf86-c0ff131cb64e tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Request method failure captured: Apr 14 10:46:44 user devstack@n-api.service[61840]: request: DELETE /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e HTTP/1.1 Apr 14 10:46:44 user devstack@n-api.service[61840]: Accept: application/json Apr 14 10:46:44 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 10:46:44 user devstack@n-api.service[61840]: Connection: close Apr 14 10:46:44 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 10:46:44 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 10:46:44 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 10:46:44 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 10:46:44 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS4ZTYo2t3gzV6wzcCjvZVKS1u7WvBJiBiUSW6K_72T-ROrxIDwhNSu8mka54GB9kRDeow9f3aHDiEy6MKt3LjwPqEGrnD-jbFmM8yoK5EO8Dfv9U_TWCR8DKyHY4uIZn9hnFcQmjsTvBf898-hKDMP8Bf7m6eAROD3WNcEKgranrwg Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Project-Id: 0e024f5a578e4543a02c6adc7d456f39 Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Project-Name: tempest-TaggedBootDevicesTest-656117710 Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e024f5a578e4543a02c6adc7d456f39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0e024f5a578e4543a02c6adc7d456f39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e024f5a578e4543a02c6adc7d456f39"}]}] Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Tenant: tempest-TaggedBootDevicesTest-656117710 Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Tenant-Id: 0e024f5a578e4543a02c6adc7d456f39 Apr 14 10:46:44 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-TaggedBootDevicesTest-656117710 Apr 14 10:46:44 user devstack@n-api.service[61840]: X-User: tempest-TaggedBootDevicesTest-656117710-project-member Apr 14 10:46:44 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 10:46:44 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 10:46:44 user devstack@n-api.service[61840]: X-User-Id: 1f6dac34303f4965babaee39bb363b5e Apr 14 10:46:44 user devstack@n-api.service[61840]: X-User-Name: tempest-TaggedBootDevicesTest-656117710-project-member Apr 14 10:46:44 user devstack@n-api.service[61840]: method: > Apr 14 10:46:44 user devstack@n-api.service[61840]: exception: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. Apr 14 10:46:44 user devstack@n-api.service[61840]: action_args: {'id': 'd1516acc-354e-41f6-a639-61dea870b11e'} Apr 14 10:46:44 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. Apr 14 10:46:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:46:44 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-92fec789-5cf4-4106-bf86-c0ff131cb64e tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Returning 404 to user: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:46:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-92fec789-5cf4-4106-bf86-c0ff131cb64e tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e" status: 404 len: 111 microversion: 2.32 time: 0.060963 Apr 14 10:46:44 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 98/298] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 10:46:44 2023] DELETE /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:46:44 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-58dd7dc9-7da8-41ff-9507-6c4572f6c4c9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:44 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-58dd7dc9-7da8-41ff-9507-6c4572f6c4c9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:44 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-58dd7dc9-7da8-41ff-9507-6c4572f6c4c9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-58dd7dc9-7da8-41ff-9507-6c4572f6c4c9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-58dd7dc9-7da8-41ff-9507-6c4572f6c4c9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-58dd7dc9-7da8-41ff-9507-6c4572f6c4c9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-58dd7dc9-7da8-41ff-9507-6c4572f6c4c9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-58dd7dc9-7da8-41ff-9507-6c4572f6c4c9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:44 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=43 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:44 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-58dd7dc9-7da8-41ff-9507-6c4572f6c4c9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] HTTP exception thrown: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. Apr 14 10:46:44 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-58dd7dc9-7da8-41ff-9507-6c4572f6c4c9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Request method failure captured: Apr 14 10:46:44 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e HTTP/1.1 Apr 14 10:46:44 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:46:44 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:46:44 user devstack@n-api.service[61839]: Connection: close Apr 14 10:46:44 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:46:44 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:46:44 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:46:44 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:46:44 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS4ZTYo2t3gzV6wzcCjvZVKS1u7WvBJiBiUSW6K_72T-ROrxIDwhNSu8mka54GB9kRDeow9f3aHDiEy6MKt3LjwPqEGrnD-jbFmM8yoK5EO8Dfv9U_TWCR8DKyHY4uIZn9hnFcQmjsTvBf898-hKDMP8Bf7m6eAROD3WNcEKgranrwg Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Project-Id: 0e024f5a578e4543a02c6adc7d456f39 Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Project-Name: tempest-TaggedBootDevicesTest-656117710 Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e024f5a578e4543a02c6adc7d456f39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0e024f5a578e4543a02c6adc7d456f39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e024f5a578e4543a02c6adc7d456f39"}]}] Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Tenant: tempest-TaggedBootDevicesTest-656117710 Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Tenant-Id: 0e024f5a578e4543a02c6adc7d456f39 Apr 14 10:46:44 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-TaggedBootDevicesTest-656117710 Apr 14 10:46:44 user devstack@n-api.service[61839]: X-User: tempest-TaggedBootDevicesTest-656117710-project-member Apr 14 10:46:44 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:46:44 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:46:44 user devstack@n-api.service[61839]: X-User-Id: 1f6dac34303f4965babaee39bb363b5e Apr 14 10:46:44 user devstack@n-api.service[61839]: X-User-Name: tempest-TaggedBootDevicesTest-656117710-project-member Apr 14 10:46:44 user devstack@n-api.service[61839]: method: > Apr 14 10:46:44 user devstack@n-api.service[61839]: exception: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. Apr 14 10:46:44 user devstack@n-api.service[61839]: action_args: {'id': 'd1516acc-354e-41f6-a639-61dea870b11e'} Apr 14 10:46:44 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. Apr 14 10:46:44 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:46:44 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-58dd7dc9-7da8-41ff-9507-6c4572f6c4c9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Returning 404 to user: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:46:44 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-58dd7dc9-7da8-41ff-9507-6c4572f6c4c9 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e" status: 404 len: 111 microversion: 2.32 time: 0.072884 Apr 14 10:46:44 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 98/299] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:46:44 2023] GET /compute/v2.1/servers/d1516acc-354e-41f6-a639-61dea870b11e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:46:45 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-88035b44-dcdd-4c51-a4fd-6b1c9c47eda2 req-cdc2e079-b9e0-4b0f-8130-e99dbafa3923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f539d8-4144-467b-ac69-44011c5b3564", "name": "network-vif-deleted", "tag": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:45 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-88035b44-dcdd-4c51-a4fd-6b1c9c47eda2 req-cdc2e079-b9e0-4b0f-8130-e99dbafa3923 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-88035b44-dcdd-4c51-a4fd-6b1c9c47eda2 req-cdc2e079-b9e0-4b0f-8130-e99dbafa3923 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-88035b44-dcdd-4c51-a4fd-6b1c9c47eda2 req-cdc2e079-b9e0-4b0f-8130-e99dbafa3923 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:45 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-88035b44-dcdd-4c51-a4fd-6b1c9c47eda2 req-cdc2e079-b9e0-4b0f-8130-e99dbafa3923 service nova] Creating event network-vif-deleted:d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 for instance d6f539d8-4144-467b-ac69-44011c5b3564 on user Apr 14 10:46:45 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-88035b44-dcdd-4c51-a4fd-6b1c9c47eda2 req-cdc2e079-b9e0-4b0f-8130-e99dbafa3923 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059396 Apr 14 10:46:45 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 104/300] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:46 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-3611a588-97a8-4454-b0ee-41d53e54137a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:46 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-3611a588-97a8-4454-b0ee-41d53e54137a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3611a588-97a8-4454-b0ee-41d53e54137a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3611a588-97a8-4454-b0ee-41d53e54137a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3611a588-97a8-4454-b0ee-41d53e54137a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3611a588-97a8-4454-b0ee-41d53e54137a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3611a588-97a8-4454-b0ee-41d53e54137a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3611a588-97a8-4454-b0ee-41d53e54137a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:46 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-3611a588-97a8-4454-b0ee-41d53e54137a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:46 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-3611a588-97a8-4454-b0ee-41d53e54137a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:46 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-3611a588-97a8-4454-b0ee-41d53e54137a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:46 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-3611a588-97a8-4454-b0ee-41d53e54137a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae" status: 200 len: 1588 microversion: 2.20 time: 0.195789 Apr 14 10:46:46 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 99/301] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:46:46 2023] GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae => generated 1588 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:46:47 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-c2ce4888-3397-4081-8aa0-6cb93b841e0c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:47 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-c2ce4888-3397-4081-8aa0-6cb93b841e0c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c2ce4888-3397-4081-8aa0-6cb93b841e0c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c2ce4888-3397-4081-8aa0-6cb93b841e0c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c2ce4888-3397-4081-8aa0-6cb93b841e0c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c2ce4888-3397-4081-8aa0-6cb93b841e0c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c2ce4888-3397-4081-8aa0-6cb93b841e0c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c2ce4888-3397-4081-8aa0-6cb93b841e0c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:47 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-c2ce4888-3397-4081-8aa0-6cb93b841e0c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:47 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-c2ce4888-3397-4081-8aa0-6cb93b841e0c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1703 microversion: 2.1 time: 0.183574 Apr 14 10:46:47 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 99/302] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:46:47 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1703 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-564468196", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting quotas for project 3ea2cb4dfa5b4a52b658efd8f5aefb36. Resources: dict_keys(['metadata_items']) {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting quotas for user 5873a358bf544691b12cd2979f5e36dc and project 3ea2cb4dfa5b4a52b658efd8f5aefb36. Resources: dict_keys(['metadata_items']) {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:47 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/action" status: 202 len: 1159 microversion: 2.1 time: 0.432239 Apr 14 10:46:47 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 105/303] 10.0.0.210 () {64 vars in 1356 bytes} [Fri Apr 14 10:46:47 2023] POST /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/action => generated 1159 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 10:46:47 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-f859e009-f301-4080-859d-123b66de9860 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:47 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-f859e009-f301-4080-859d-123b66de9860 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:47 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f859e009-f301-4080-859d-123b66de9860 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f859e009-f301-4080-859d-123b66de9860 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f859e009-f301-4080-859d-123b66de9860 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f859e009-f301-4080-859d-123b66de9860 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f859e009-f301-4080-859d-123b66de9860 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f859e009-f301-4080-859d-123b66de9860 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:47 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:46:47 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-f859e009-f301-4080-859d-123b66de9860 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:48 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-f859e009-f301-4080-859d-123b66de9860 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1731 microversion: 2.1 time: 0.195776 Apr 14 10:46:48 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 100/304] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:46:47 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:46:48 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-8a3a03ca-735b-44a5-a597-bbe3aa73d32c req-e829eb27-694b-4687-8a15-9554b8d0c4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-unplugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8a3a03ca-735b-44a5-a597-bbe3aa73d32c req-e829eb27-694b-4687-8a15-9554b8d0c4d2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8a3a03ca-735b-44a5-a597-bbe3aa73d32c req-e829eb27-694b-4687-8a15-9554b8d0c4d2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:48 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8a3a03ca-735b-44a5-a597-bbe3aa73d32c req-e829eb27-694b-4687-8a15-9554b8d0c4d2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:48 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-8a3a03ca-735b-44a5-a597-bbe3aa73d32c req-e829eb27-694b-4687-8a15-9554b8d0c4d2 service nova] Creating event network-vif-unplugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:46:48 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-8a3a03ca-735b-44a5-a597-bbe3aa73d32c req-e829eb27-694b-4687-8a15-9554b8d0c4d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034230 Apr 14 10:46:48 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 100/305] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:50 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-plugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}, {"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-plugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}, {"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-plugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}, {"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-unplugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}, {"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-plugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Creating event network-vif-plugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:46:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Creating event network-vif-plugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:46:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Creating event network-vif-plugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:46:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Creating event network-vif-unplugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:46:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Creating event network-vif-plugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:46:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.051669 Apr 14 10:46:50 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 106/306] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:50 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:51 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "aefc0dd9-6bb6-4a2f-ada9-e21b5f4d6151"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:51 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:51 user devstack@n-api.service[61840]: DEBUG nova.objects.instance [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lazy-loading 'flavor' on Instance uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=61840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:46:52 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/action" status: 200 len: 29 microversion: 2.1 time: 0.625140 Apr 14 10:46:52 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 101/307] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:46:51 2023] POST /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/action => generated 29 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:46:52 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f2110a27-5440-41ff-9bc8-d43b0b7c8296 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:46:52 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-f2110a27-5440-41ff-9bc8-d43b0b7c8296 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:46:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f2110a27-5440-41ff-9bc8-d43b0b7c8296 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f2110a27-5440-41ff-9bc8-d43b0b7c8296 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f2110a27-5440-41ff-9bc8-d43b0b7c8296 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f2110a27-5440-41ff-9bc8-d43b0b7c8296 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f2110a27-5440-41ff-9bc8-d43b0b7c8296 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f2110a27-5440-41ff-9bc8-d43b0b7c8296 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:52 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-f2110a27-5440-41ff-9bc8-d43b0b7c8296 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7212c3fe50ef465c99a0eefec4cbd753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482809b9148e408b84b156802a21a225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:46:52 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-f2110a27-5440-41ff-9bc8-d43b0b7c8296 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce" status: 200 len: 1723 microversion: 2.1 time: 0.200525 Apr 14 10:46:52 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 101/308] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:46:52 2023] GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:46:53 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-7663a8e4-382c-41f3-9d89-7374a8e78369 req-cfba2239-3e55-430a-b9ed-93863fd55563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "name": "network-vif-unplugged", "status": "completed", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7663a8e4-382c-41f3-9d89-7374a8e78369 req-cfba2239-3e55-430a-b9ed-93863fd55563 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7663a8e4-382c-41f3-9d89-7374a8e78369 req-cfba2239-3e55-430a-b9ed-93863fd55563 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7663a8e4-382c-41f3-9d89-7374a8e78369 req-cfba2239-3e55-430a-b9ed-93863fd55563 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:53 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-7663a8e4-382c-41f3-9d89-7374a8e78369 req-cfba2239-3e55-430a-b9ed-93863fd55563 service nova] Creating event network-vif-unplugged:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:46:53 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-7663a8e4-382c-41f3-9d89-7374a8e78369 req-cfba2239-3e55-430a-b9ed-93863fd55563 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032485 Apr 14 10:46:53 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 107/309] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:55 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-a105a47d-8e89-4397-82ce-6258a3cd4a3f req-07db0708-b729-4e82-80b6-055e80df7942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "name": "network-vif-plugged", "status": "completed", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-a105a47d-8e89-4397-82ce-6258a3cd4a3f req-07db0708-b729-4e82-80b6-055e80df7942 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-a105a47d-8e89-4397-82ce-6258a3cd4a3f req-07db0708-b729-4e82-80b6-055e80df7942 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-a105a47d-8e89-4397-82ce-6258a3cd4a3f req-07db0708-b729-4e82-80b6-055e80df7942 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:55 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-a105a47d-8e89-4397-82ce-6258a3cd4a3f req-07db0708-b729-4e82-80b6-055e80df7942 service nova] Creating event network-vif-plugged:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:46:55 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-a105a47d-8e89-4397-82ce-6258a3cd4a3f req-07db0708-b729-4e82-80b6-055e80df7942 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028519 Apr 14 10:46:55 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 102/310] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:57 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-4463727f-c945-4105-acdc-5e3a8de572c1 req-3b082136-8306-40bd-b8a4-98b5c36a4234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "name": "network-vif-plugged", "status": "completed", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:57 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4463727f-c945-4105-acdc-5e3a8de572c1 req-3b082136-8306-40bd-b8a4-98b5c36a4234 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:57 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4463727f-c945-4105-acdc-5e3a8de572c1 req-3b082136-8306-40bd-b8a4-98b5c36a4234 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:57 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4463727f-c945-4105-acdc-5e3a8de572c1 req-3b082136-8306-40bd-b8a4-98b5c36a4234 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:57 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-4463727f-c945-4105-acdc-5e3a8de572c1 req-3b082136-8306-40bd-b8a4-98b5c36a4234 service nova] Creating event network-vif-plugged:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:46:57 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-4463727f-c945-4105-acdc-5e3a8de572c1 req-3b082136-8306-40bd-b8a4-98b5c36a4234 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037557 Apr 14 10:46:57 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 102/311] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:46:59 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-06bd5d69-ae71-43ba-b86a-857fa1257e91 req-f3d026ad-54c4-4b53-9c59-cc690bfbbd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "name": "network-vif-plugged", "status": "completed", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:46:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-06bd5d69-ae71-43ba-b86a-857fa1257e91 req-f3d026ad-54c4-4b53-9c59-cc690bfbbd43 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:46:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-06bd5d69-ae71-43ba-b86a-857fa1257e91 req-f3d026ad-54c4-4b53-9c59-cc690bfbbd43 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:46:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-06bd5d69-ae71-43ba-b86a-857fa1257e91 req-f3d026ad-54c4-4b53-9c59-cc690bfbbd43 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:46:59 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-06bd5d69-ae71-43ba-b86a-857fa1257e91 req-f3d026ad-54c4-4b53-9c59-cc690bfbbd43 service nova] Creating event network-vif-plugged:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:47:00 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-06bd5d69-ae71-43ba-b86a-857fa1257e91 req-f3d026ad-54c4-4b53-9c59-cc690bfbbd43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046001 Apr 14 10:47:00 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 108/312] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:46:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:04 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-ed9e42f2-e306-411c-9a7e-2735c9a0b9f7 req-f9835eca-dddc-4268-8f0d-082510483752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-plugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ed9e42f2-e306-411c-9a7e-2735c9a0b9f7 req-f9835eca-dddc-4268-8f0d-082510483752 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ed9e42f2-e306-411c-9a7e-2735c9a0b9f7 req-f9835eca-dddc-4268-8f0d-082510483752 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ed9e42f2-e306-411c-9a7e-2735c9a0b9f7 req-f9835eca-dddc-4268-8f0d-082510483752 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:04 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-ed9e42f2-e306-411c-9a7e-2735c9a0b9f7 req-f9835eca-dddc-4268-8f0d-082510483752 service nova] Creating event network-vif-plugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:47:04 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-ed9e42f2-e306-411c-9a7e-2735c9a0b9f7 req-f9835eca-dddc-4268-8f0d-082510483752 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061998 Apr 14 10:47:04 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 103/313] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:04 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-b178f8d8-ffd6-429a-a72f-b6d950b98adb tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d10cb80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1911408091", "metadata": {"Type": "work"}}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:04 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-b178f8d8-ffd6-429a-a72f-b6d950b98adb tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Request method failure captured: Apr 14 10:47:04 user devstack@n-api.service[61839]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 10:47:04 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:47:04 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:47:04 user devstack@n-api.service[61839]: Connection: close Apr 14 10:47:04 user devstack@n-api.service[61839]: Content-Length: 122 Apr 14 10:47:04 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:47:04 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:47:04 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:47:04 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:47:04 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS8ond5eJz5T8sSe_TGYHKfiC4RacW23IAWMyEjKU_pfr18xpcIAsytRdAGJIkkHuq99vdEGewgb6Ccrbi1xEDUY317lT8v6ycycnXvb6fR8FqJek36KkJfJ3Wq0Mj6VD8bephro_OxRB0_5DGBvtehe__Y1EoavomLOEZttecU0GV0 Apr 14 10:47:04 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:47:04 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:47:04 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:47:04 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:47:04 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:47:04 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:47:04 user devstack@n-api.service[61839]: X-Project-Id: 286f565ab56a4e389423f4152ccfe0f1 Apr 14 10:47:04 user devstack@n-api.service[61839]: X-Project-Name: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:04 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:47:04 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:47:04 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/286f565ab56a4e389423f4152ccfe0f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/286f565ab56a4e389423f4152ccfe0f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/286f565ab56a4e389423f4152ccfe0f1"}]}] Apr 14 10:47:04 user devstack@n-api.service[61839]: X-Tenant: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:04 user devstack@n-api.service[61839]: X-Tenant-Id: 286f565ab56a4e389423f4152ccfe0f1 Apr 14 10:47:04 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:04 user devstack@n-api.service[61839]: X-User: tempest-VolumesNegativeTest-517793184-project-member Apr 14 10:47:04 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:47:04 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:47:04 user devstack@n-api.service[61839]: X-User-Id: c1cfc4ee3ef14eaaa8f22aeeaa0d9e27 Apr 14 10:47:04 user devstack@n-api.service[61839]: X-User-Name: tempest-VolumesNegativeTest-517793184-project-member Apr 14 10:47:04 user devstack@n-api.service[61839]: Apr 14 10:47:04 user devstack@n-api.service[61839]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1911408091", "metadata": {"Type": "work"}}} Apr 14 10:47:04 user devstack@n-api.service[61839]: method: Apr 14 10:47:04 user devstack@n-api.service[61839]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 10:47:04 user devstack@n-api.service[61839]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1911408091', 'metadata': {'Type': 'work'}}}} Apr 14 10:47:04 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise error Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi '#$%' Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 10:47:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:04 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-b178f8d8-ffd6-429a-a72f-b6d950b98adb tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:47:04 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-b178f8d8-ffd6-429a-a72f-b6d950b98adb tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.368454 Apr 14 10:47:04 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 103/314] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 10:47:04 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 370 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:47:04 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-6f0f7743-59a9-4d49-a664-b360251a2435 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d36d1b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2043217318", "metadata": {"Type": "work"}}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:04 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-6f0f7743-59a9-4d49-a664-b360251a2435 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Request method failure captured: Apr 14 10:47:04 user devstack@n-api.service[61841]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 10:47:04 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:47:04 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:47:04 user devstack@n-api.service[61841]: Connection: close Apr 14 10:47:04 user devstack@n-api.service[61841]: Content-Length: 120 Apr 14 10:47:04 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:47:04 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:47:04 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:47:04 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:47:04 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS8ond5eJz5T8sSe_TGYHKfiC4RacW23IAWMyEjKU_pfr18xpcIAsytRdAGJIkkHuq99vdEGewgb6Ccrbi1xEDUY317lT8v6ycycnXvb6fR8FqJek36KkJfJ3Wq0Mj6VD8bephro_OxRB0_5DGBvtehe__Y1EoavomLOEZttecU0GV0 Apr 14 10:47:04 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:47:04 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:47:04 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:47:04 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:47:04 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:47:04 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:47:04 user devstack@n-api.service[61841]: X-Project-Id: 286f565ab56a4e389423f4152ccfe0f1 Apr 14 10:47:04 user devstack@n-api.service[61841]: X-Project-Name: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:04 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:47:04 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:47:04 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/286f565ab56a4e389423f4152ccfe0f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/286f565ab56a4e389423f4152ccfe0f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/286f565ab56a4e389423f4152ccfe0f1"}]}] Apr 14 10:47:04 user devstack@n-api.service[61841]: X-Tenant: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:04 user devstack@n-api.service[61841]: X-Tenant-Id: 286f565ab56a4e389423f4152ccfe0f1 Apr 14 10:47:04 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:04 user devstack@n-api.service[61841]: X-User: tempest-VolumesNegativeTest-517793184-project-member Apr 14 10:47:04 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:47:04 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:47:04 user devstack@n-api.service[61841]: X-User-Id: c1cfc4ee3ef14eaaa8f22aeeaa0d9e27 Apr 14 10:47:04 user devstack@n-api.service[61841]: X-User-Name: tempest-VolumesNegativeTest-517793184-project-member Apr 14 10:47:04 user devstack@n-api.service[61841]: Apr 14 10:47:04 user devstack@n-api.service[61841]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2043217318", "metadata": {"Type": "work"}}} Apr 14 10:47:04 user devstack@n-api.service[61841]: method: Apr 14 10:47:04 user devstack@n-api.service[61841]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 10:47:04 user devstack@n-api.service[61841]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2043217318', 'metadata': {'Type': 'work'}}}} Apr 14 10:47:04 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise error Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi '0' Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 10:47:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:04 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-6f0f7743-59a9-4d49-a664-b360251a2435 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:47:04 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-6f0f7743-59a9-4d49-a664-b360251a2435 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013594 Apr 14 10:47:04 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 109/315] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 10:47:04 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:47:05 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-a966884e-5067-4b06-a12f-beb6feeeb058 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d1268c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1965423209", "metadata": {"Type": "work"}}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:05 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-a966884e-5067-4b06-a12f-beb6feeeb058 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Request method failure captured: Apr 14 10:47:05 user devstack@n-api.service[61840]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 10:47:05 user devstack@n-api.service[61840]: Accept: application/json Apr 14 10:47:05 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 10:47:05 user devstack@n-api.service[61840]: Connection: close Apr 14 10:47:05 user devstack@n-api.service[61840]: Content-Length: 119 Apr 14 10:47:05 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 10:47:05 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 10:47:05 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 10:47:05 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 10:47:05 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS8ond5eJz5T8sSe_TGYHKfiC4RacW23IAWMyEjKU_pfr18xpcIAsytRdAGJIkkHuq99vdEGewgb6Ccrbi1xEDUY317lT8v6ycycnXvb6fR8FqJek36KkJfJ3Wq0Mj6VD8bephro_OxRB0_5DGBvtehe__Y1EoavomLOEZttecU0GV0 Apr 14 10:47:05 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 10:47:05 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 10:47:05 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 10:47:05 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 10:47:05 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 10:47:05 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 10:47:05 user devstack@n-api.service[61840]: X-Project-Id: 286f565ab56a4e389423f4152ccfe0f1 Apr 14 10:47:05 user devstack@n-api.service[61840]: X-Project-Name: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:05 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 10:47:05 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 10:47:05 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/286f565ab56a4e389423f4152ccfe0f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/286f565ab56a4e389423f4152ccfe0f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/286f565ab56a4e389423f4152ccfe0f1"}]}] Apr 14 10:47:05 user devstack@n-api.service[61840]: X-Tenant: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:05 user devstack@n-api.service[61840]: X-Tenant-Id: 286f565ab56a4e389423f4152ccfe0f1 Apr 14 10:47:05 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:05 user devstack@n-api.service[61840]: X-User: tempest-VolumesNegativeTest-517793184-project-member Apr 14 10:47:05 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 10:47:05 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 10:47:05 user devstack@n-api.service[61840]: X-User-Id: c1cfc4ee3ef14eaaa8f22aeeaa0d9e27 Apr 14 10:47:05 user devstack@n-api.service[61840]: X-User-Name: tempest-VolumesNegativeTest-517793184-project-member Apr 14 10:47:05 user devstack@n-api.service[61840]: Apr 14 10:47:05 user devstack@n-api.service[61840]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1965423209", "metadata": {"Type": "work"}}} Apr 14 10:47:05 user devstack@n-api.service[61840]: method: Apr 14 10:47:05 user devstack@n-api.service[61840]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 10:47:05 user devstack@n-api.service[61840]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1965423209', 'metadata': {'Type': 'work'}}}} Apr 14 10:47:05 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise error Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi '' Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 10:47:05 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-a966884e-5067-4b06-a12f-beb6feeeb058 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:47:05 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-a966884e-5067-4b06-a12f-beb6feeeb058 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013847 Apr 14 10:47:05 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 104/316] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 10:47:04 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:47:05 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-47d32aa3-643e-4137-8089-3a7e30a35d5f tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Calling method '.version_select at 0x7fcd1d298d30>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:05 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-47d32aa3-643e-4137-8089-3a7e30a35d5f tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] HTTP exception thrown: Volume tempest-invalid-742807267 could not be found. Apr 14 10:47:05 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-47d32aa3-643e-4137-8089-3a7e30a35d5f tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Request method failure captured: Apr 14 10:47:05 user devstack@n-api.service[61839]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-742807267 HTTP/1.1 Apr 14 10:47:05 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:47:05 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:47:05 user devstack@n-api.service[61839]: Connection: close Apr 14 10:47:05 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:47:05 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:47:05 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:47:05 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:47:05 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS8ond5eJz5T8sSe_TGYHKfiC4RacW23IAWMyEjKU_pfr18xpcIAsytRdAGJIkkHuq99vdEGewgb6Ccrbi1xEDUY317lT8v6ycycnXvb6fR8FqJek36KkJfJ3Wq0Mj6VD8bephro_OxRB0_5DGBvtehe__Y1EoavomLOEZttecU0GV0 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Project-Id: 286f565ab56a4e389423f4152ccfe0f1 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Project-Name: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/286f565ab56a4e389423f4152ccfe0f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/286f565ab56a4e389423f4152ccfe0f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/286f565ab56a4e389423f4152ccfe0f1"}]}] Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Tenant: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Tenant-Id: 286f565ab56a4e389423f4152ccfe0f1 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-User: tempest-VolumesNegativeTest-517793184-project-member Apr 14 10:47:05 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:47:05 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:47:05 user devstack@n-api.service[61839]: X-User-Id: c1cfc4ee3ef14eaaa8f22aeeaa0d9e27 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-User-Name: tempest-VolumesNegativeTest-517793184-project-member Apr 14 10:47:05 user devstack@n-api.service[61839]: method: Apr 14 10:47:05 user devstack@n-api.service[61839]: exception: Volume tempest-invalid-742807267 could not be found. Apr 14 10:47:05 user devstack@n-api.service[61839]: action_args: {'id': 'tempest-invalid-742807267'} Apr 14 10:47:05 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-742807267 could not be found. (HTTP 404) (Request-ID: req-8f6d3828-19c0-4689-8e0d-8b06b171d42f) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-742807267 could not be found. Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-742807267 could not be found. Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-742807267 could not be found. Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-47d32aa3-643e-4137-8089-3a7e30a35d5f tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Returning 404 to user: Volume tempest-invalid-742807267 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:47:05 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-47d32aa3-643e-4137-8089-3a7e30a35d5f tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-742807267" status: 404 len: 98 microversion: 2.1 time: 0.052029 Apr 14 10:47:05 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 104/317] 10.0.0.210 () {62 vars in 1292 bytes} [Fri Apr 14 10:47:05 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-742807267 => generated 98 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 14 10:47:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-2ab3664f-75df-4503-8d5e-0c548286effa tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006061 Apr 14 10:47:05 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 110/318] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 10:47:05 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 14 10:47:05 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-65778937-6b6b-45d4-879d-d609d81ef468 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008353 Apr 14 10:47:05 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 105/319] 10.0.0.210 () {62 vars in 1214 bytes} [Fri Apr 14 10:47:05 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 10:47:05 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-4050c2ab-8d85-4b49-a3fa-d9d47e20bd80 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Calling method '.version_select at 0x7fcd1d10ea70>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:05 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-4050c2ab-8d85-4b49-a3fa-d9d47e20bd80 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] HTTP exception thrown: Volume bbdb9fd0-4f00-4f9c-aab1-0c82aea63ad1 could not be found. Apr 14 10:47:05 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-4050c2ab-8d85-4b49-a3fa-d9d47e20bd80 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Request method failure captured: Apr 14 10:47:05 user devstack@n-api.service[61839]: request: DELETE /compute/v2.1/os-volumes/bbdb9fd0-4f00-4f9c-aab1-0c82aea63ad1 HTTP/1.1 Apr 14 10:47:05 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:47:05 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:47:05 user devstack@n-api.service[61839]: Connection: close Apr 14 10:47:05 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:47:05 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:47:05 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:47:05 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:47:05 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS8ond5eJz5T8sSe_TGYHKfiC4RacW23IAWMyEjKU_pfr18xpcIAsytRdAGJIkkHuq99vdEGewgb6Ccrbi1xEDUY317lT8v6ycycnXvb6fR8FqJek36KkJfJ3Wq0Mj6VD8bephro_OxRB0_5DGBvtehe__Y1EoavomLOEZttecU0GV0 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Project-Id: 286f565ab56a4e389423f4152ccfe0f1 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Project-Name: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/286f565ab56a4e389423f4152ccfe0f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/286f565ab56a4e389423f4152ccfe0f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/286f565ab56a4e389423f4152ccfe0f1"}]}] Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Tenant: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Tenant-Id: 286f565ab56a4e389423f4152ccfe0f1 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-User: tempest-VolumesNegativeTest-517793184-project-member Apr 14 10:47:05 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:47:05 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:47:05 user devstack@n-api.service[61839]: X-User-Id: c1cfc4ee3ef14eaaa8f22aeeaa0d9e27 Apr 14 10:47:05 user devstack@n-api.service[61839]: X-User-Name: tempest-VolumesNegativeTest-517793184-project-member Apr 14 10:47:05 user devstack@n-api.service[61839]: method: Apr 14 10:47:05 user devstack@n-api.service[61839]: exception: Volume bbdb9fd0-4f00-4f9c-aab1-0c82aea63ad1 could not be found. Apr 14 10:47:05 user devstack@n-api.service[61839]: action_args: {'id': 'bbdb9fd0-4f00-4f9c-aab1-0c82aea63ad1'} Apr 14 10:47:05 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bbdb9fd0-4f00-4f9c-aab1-0c82aea63ad1 could not be found. (HTTP 404) (Request-ID: req-8a7f4d0f-9322-4dd6-ae1a-3cc0c922fa0a) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bbdb9fd0-4f00-4f9c-aab1-0c82aea63ad1 could not be found. Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bbdb9fd0-4f00-4f9c-aab1-0c82aea63ad1 could not be found. Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bbdb9fd0-4f00-4f9c-aab1-0c82aea63ad1 could not be found. Apr 14 10:47:05 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-4050c2ab-8d85-4b49-a3fa-d9d47e20bd80 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Returning 404 to user: Volume bbdb9fd0-4f00-4f9c-aab1-0c82aea63ad1 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:47:05 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-4050c2ab-8d85-4b49-a3fa-d9d47e20bd80 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/bbdb9fd0-4f00-4f9c-aab1-0c82aea63ad1" status: 404 len: 109 microversion: 2.1 time: 0.036535 Apr 14 10:47:05 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 105/320] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 10:47:05 2023] DELETE /compute/v2.1/os-volumes/bbdb9fd0-4f00-4f9c-aab1-0c82aea63ad1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:47:05 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-76d4d174-ffcd-46bb-a36d-7e5bf96875a9 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Calling method '.version_select at 0x7fcd1d36c790>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-76d4d174-ffcd-46bb-a36d-7e5bf96875a9 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] HTTP exception thrown: Volume 832764ce-bb7b-4b29-ba10-4d9cc10dc7d5 could not be found. Apr 14 10:47:05 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-76d4d174-ffcd-46bb-a36d-7e5bf96875a9 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Request method failure captured: Apr 14 10:47:05 user devstack@n-api.service[61841]: request: GET /compute/v2.1/os-volumes/832764ce-bb7b-4b29-ba10-4d9cc10dc7d5 HTTP/1.1 Apr 14 10:47:05 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:47:05 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:47:05 user devstack@n-api.service[61841]: Connection: close Apr 14 10:47:05 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 10:47:05 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:47:05 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:47:05 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:47:05 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:47:05 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS8ond5eJz5T8sSe_TGYHKfiC4RacW23IAWMyEjKU_pfr18xpcIAsytRdAGJIkkHuq99vdEGewgb6Ccrbi1xEDUY317lT8v6ycycnXvb6fR8FqJek36KkJfJ3Wq0Mj6VD8bephro_OxRB0_5DGBvtehe__Y1EoavomLOEZttecU0GV0 Apr 14 10:47:05 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:47:05 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:47:05 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:47:05 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:47:05 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:47:05 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:47:05 user devstack@n-api.service[61841]: X-Project-Id: 286f565ab56a4e389423f4152ccfe0f1 Apr 14 10:47:05 user devstack@n-api.service[61841]: X-Project-Name: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:05 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:47:05 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:47:05 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/286f565ab56a4e389423f4152ccfe0f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/286f565ab56a4e389423f4152ccfe0f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/286f565ab56a4e389423f4152ccfe0f1"}]}] Apr 14 10:47:05 user devstack@n-api.service[61841]: X-Tenant: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:05 user devstack@n-api.service[61841]: X-Tenant-Id: 286f565ab56a4e389423f4152ccfe0f1 Apr 14 10:47:05 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-VolumesNegativeTest-517793184 Apr 14 10:47:05 user devstack@n-api.service[61841]: X-User: tempest-VolumesNegativeTest-517793184-project-member Apr 14 10:47:05 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:47:05 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:47:05 user devstack@n-api.service[61841]: X-User-Id: c1cfc4ee3ef14eaaa8f22aeeaa0d9e27 Apr 14 10:47:05 user devstack@n-api.service[61841]: X-User-Name: tempest-VolumesNegativeTest-517793184-project-member Apr 14 10:47:05 user devstack@n-api.service[61841]: method: Apr 14 10:47:05 user devstack@n-api.service[61841]: exception: Volume 832764ce-bb7b-4b29-ba10-4d9cc10dc7d5 could not be found. Apr 14 10:47:05 user devstack@n-api.service[61841]: action_args: {'id': '832764ce-bb7b-4b29-ba10-4d9cc10dc7d5'} Apr 14 10:47:05 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 832764ce-bb7b-4b29-ba10-4d9cc10dc7d5 could not be found. (HTTP 404) (Request-ID: req-6eabc730-736a-4dca-92c2-999313e0ded5) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 832764ce-bb7b-4b29-ba10-4d9cc10dc7d5 could not be found. Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 832764ce-bb7b-4b29-ba10-4d9cc10dc7d5 could not be found. Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 832764ce-bb7b-4b29-ba10-4d9cc10dc7d5 could not be found. Apr 14 10:47:05 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:05 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-76d4d174-ffcd-46bb-a36d-7e5bf96875a9 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] Returning 404 to user: Volume 832764ce-bb7b-4b29-ba10-4d9cc10dc7d5 could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:47:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-76d4d174-ffcd-46bb-a36d-7e5bf96875a9 tempest-VolumesNegativeTest-517793184 tempest-VolumesNegativeTest-517793184-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/832764ce-bb7b-4b29-ba10-4d9cc10dc7d5" status: 404 len: 109 microversion: 2.1 time: 0.050506 Apr 14 10:47:05 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 111/321] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 10:47:05 2023] GET /compute/v2.1/os-volumes/832764ce-bb7b-4b29-ba10-4d9cc10dc7d5 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:47:06 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-18833a60-fa1c-436c-b726-c1deef38f4b5 req-9091ad87-1b5a-4867-91db-b94ceeefa829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-plugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-18833a60-fa1c-436c-b726-c1deef38f4b5 req-9091ad87-1b5a-4867-91db-b94ceeefa829 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-18833a60-fa1c-436c-b726-c1deef38f4b5 req-9091ad87-1b5a-4867-91db-b94ceeefa829 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-18833a60-fa1c-436c-b726-c1deef38f4b5 req-9091ad87-1b5a-4867-91db-b94ceeefa829 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:06 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-18833a60-fa1c-436c-b726-c1deef38f4b5 req-9091ad87-1b5a-4867-91db-b94ceeefa829 service nova] Creating event network-vif-plugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:47:06 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-18833a60-fa1c-436c-b726-c1deef38f4b5 req-9091ad87-1b5a-4867-91db-b94ceeefa829 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037499 Apr 14 10:47:06 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 106/322] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:07 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-807ddb16-74e5-440d-8567-dfc0a0ad54f2 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:07 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-807ddb16-74e5-440d-8567-dfc0a0ad54f2 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-807ddb16-74e5-440d-8567-dfc0a0ad54f2 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-807ddb16-74e5-440d-8567-dfc0a0ad54f2 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-807ddb16-74e5-440d-8567-dfc0a0ad54f2 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-807ddb16-74e5-440d-8567-dfc0a0ad54f2 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-807ddb16-74e5-440d-8567-dfc0a0ad54f2 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-807ddb16-74e5-440d-8567-dfc0a0ad54f2 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:07 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-807ddb16-74e5-440d-8567-dfc0a0ad54f2 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047855 Apr 14 10:47:07 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 106/323] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:47:07 2023] GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:47:09 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-608c710f-3717-4f95-b976-288ecf620b6a tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:09 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-608c710f-3717-4f95-b976-288ecf620b6a tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-608c710f-3717-4f95-b976-288ecf620b6a tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-608c710f-3717-4f95-b976-288ecf620b6a tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-608c710f-3717-4f95-b976-288ecf620b6a tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-608c710f-3717-4f95-b976-288ecf620b6a tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-608c710f-3717-4f95-b976-288ecf620b6a tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-608c710f-3717-4f95-b976-288ecf620b6a tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:09 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=10,nova_cell1:INSERT=5,nova_cell1:DELETE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:09 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-608c710f-3717-4f95-b976-288ecf620b6a tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] HTTP exception thrown: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. Apr 14 10:47:09 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-608c710f-3717-4f95-b976-288ecf620b6a tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Request method failure captured: Apr 14 10:47:09 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d HTTP/1.1 Apr 14 10:47:09 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:47:09 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:47:09 user devstack@n-api.service[61841]: Connection: close Apr 14 10:47:09 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 10:47:09 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:47:09 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:47:09 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:47:09 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4hvzIaL2VFLGgFExfFOY99i9R2Yox5N-nWM1LHC_LCIjGUuEhPnxW6iH_0ElLdrnOKkrfFHqozLn-gKyqfl6a8FfVTbD0oIIy6z5ilbkG9DtP-mNeXU8l60ZJj2ucAiQ2jfSHi4zX2FMr2Wa_h465sMeiSSa5T4DvoJrc0ZZDu5AM Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Project-Id: fe8cdf0a5d7f49a9897167eb79dbfc39 Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Project-Name: tempest-TaggedAttachmentsTest-1745854352 Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fe8cdf0a5d7f49a9897167eb79dbfc39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fe8cdf0a5d7f49a9897167eb79dbfc39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fe8cdf0a5d7f49a9897167eb79dbfc39"}]}] Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Tenant: tempest-TaggedAttachmentsTest-1745854352 Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Tenant-Id: fe8cdf0a5d7f49a9897167eb79dbfc39 Apr 14 10:47:09 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1745854352 Apr 14 10:47:09 user devstack@n-api.service[61841]: X-User: tempest-TaggedAttachmentsTest-1745854352-project-member Apr 14 10:47:09 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:47:09 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:47:09 user devstack@n-api.service[61841]: X-User-Id: c7ce31180e5946d4a027ae6ac9d136fa Apr 14 10:47:09 user devstack@n-api.service[61841]: X-User-Name: tempest-TaggedAttachmentsTest-1745854352-project-member Apr 14 10:47:09 user devstack@n-api.service[61841]: method: > Apr 14 10:47:09 user devstack@n-api.service[61841]: exception: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. Apr 14 10:47:09 user devstack@n-api.service[61841]: action_args: {'id': '31f6ad8c-40d3-4b6e-af07-4848fafc431d'} Apr 14 10:47:09 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. Apr 14 10:47:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:09 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-608c710f-3717-4f95-b976-288ecf620b6a tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Returning 404 to user: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:47:09 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-608c710f-3717-4f95-b976-288ecf620b6a tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d" status: 404 len: 111 microversion: 2.49 time: 0.050911 Apr 14 10:47:09 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 112/324] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:47:09 2023] GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:47:09 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-4574aa05-4da3-4f28-b373-636dd8a86681 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Calling method '.version_select at 0x7fcd1d1d0550>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:09 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-4574aa05-4da3-4f28-b373-636dd8a86681 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362955333" status: 204 len: 0 microversion: 2.49 time: 0.040021 Apr 14 10:47:09 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 107/325] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 10:47:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362955333 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 10:47:11 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-62fbafae-9773-4603-a4a5-ea36722db96d tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:11 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-62fbafae-9773-4603-a4a5-ea36722db96d tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-62fbafae-9773-4603-a4a5-ea36722db96d tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-62fbafae-9773-4603-a4a5-ea36722db96d tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-62fbafae-9773-4603-a4a5-ea36722db96d tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-62fbafae-9773-4603-a4a5-ea36722db96d tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-62fbafae-9773-4603-a4a5-ea36722db96d tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-62fbafae-9773-4603-a4a5-ea36722db96d tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:11 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-62fbafae-9773-4603-a4a5-ea36722db96d tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] HTTP exception thrown: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. Apr 14 10:47:11 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-62fbafae-9773-4603-a4a5-ea36722db96d tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Request method failure captured: Apr 14 10:47:11 user devstack@n-api.service[61839]: request: DELETE /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d HTTP/1.1 Apr 14 10:47:11 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:47:11 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:47:11 user devstack@n-api.service[61839]: Connection: close Apr 14 10:47:11 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:47:11 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:47:11 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:47:11 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:47:11 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS4hvzIaL2VFLGgFExfFOY99i9R2Yox5N-nWM1LHC_LCIjGUuEhPnxW6iH_0ElLdrnOKkrfFHqozLn-gKyqfl6a8FfVTbD0oIIy6z5ilbkG9DtP-mNeXU8l60ZJj2ucAiQ2jfSHi4zX2FMr2Wa_h465sMeiSSa5T4DvoJrc0ZZDu5AM Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Project-Id: fe8cdf0a5d7f49a9897167eb79dbfc39 Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Project-Name: tempest-TaggedAttachmentsTest-1745854352 Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fe8cdf0a5d7f49a9897167eb79dbfc39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fe8cdf0a5d7f49a9897167eb79dbfc39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fe8cdf0a5d7f49a9897167eb79dbfc39"}]}] Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Tenant: tempest-TaggedAttachmentsTest-1745854352 Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Tenant-Id: fe8cdf0a5d7f49a9897167eb79dbfc39 Apr 14 10:47:11 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1745854352 Apr 14 10:47:11 user devstack@n-api.service[61839]: X-User: tempest-TaggedAttachmentsTest-1745854352-project-member Apr 14 10:47:11 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:47:11 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:47:11 user devstack@n-api.service[61839]: X-User-Id: c7ce31180e5946d4a027ae6ac9d136fa Apr 14 10:47:11 user devstack@n-api.service[61839]: X-User-Name: tempest-TaggedAttachmentsTest-1745854352-project-member Apr 14 10:47:11 user devstack@n-api.service[61839]: method: > Apr 14 10:47:11 user devstack@n-api.service[61839]: exception: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. Apr 14 10:47:11 user devstack@n-api.service[61839]: action_args: {'id': '31f6ad8c-40d3-4b6e-af07-4848fafc431d'} Apr 14 10:47:11 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. Apr 14 10:47:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:11 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-62fbafae-9773-4603-a4a5-ea36722db96d tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Returning 404 to user: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:47:11 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-62fbafae-9773-4603-a4a5-ea36722db96d tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d" status: 404 len: 111 microversion: 2.49 time: 0.032529 Apr 14 10:47:11 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 107/326] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 10:47:11 2023] DELETE /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:47:11 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9586380a-5ba8-44fd-9b0f-67dff25e8b17 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:11 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-9586380a-5ba8-44fd-9b0f-67dff25e8b17 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9586380a-5ba8-44fd-9b0f-67dff25e8b17 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9586380a-5ba8-44fd-9b0f-67dff25e8b17 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9586380a-5ba8-44fd-9b0f-67dff25e8b17 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9586380a-5ba8-44fd-9b0f-67dff25e8b17 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9586380a-5ba8-44fd-9b0f-67dff25e8b17 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9586380a-5ba8-44fd-9b0f-67dff25e8b17 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:11 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-9586380a-5ba8-44fd-9b0f-67dff25e8b17 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] HTTP exception thrown: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. Apr 14 10:47:11 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9586380a-5ba8-44fd-9b0f-67dff25e8b17 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Request method failure captured: Apr 14 10:47:11 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d HTTP/1.1 Apr 14 10:47:11 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:47:11 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:47:11 user devstack@n-api.service[61841]: Connection: close Apr 14 10:47:11 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 10:47:11 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:47:11 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:47:11 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:47:11 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4hvzIaL2VFLGgFExfFOY99i9R2Yox5N-nWM1LHC_LCIjGUuEhPnxW6iH_0ElLdrnOKkrfFHqozLn-gKyqfl6a8FfVTbD0oIIy6z5ilbkG9DtP-mNeXU8l60ZJj2ucAiQ2jfSHi4zX2FMr2Wa_h465sMeiSSa5T4DvoJrc0ZZDu5AM Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Project-Id: fe8cdf0a5d7f49a9897167eb79dbfc39 Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Project-Name: tempest-TaggedAttachmentsTest-1745854352 Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fe8cdf0a5d7f49a9897167eb79dbfc39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fe8cdf0a5d7f49a9897167eb79dbfc39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fe8cdf0a5d7f49a9897167eb79dbfc39"}]}] Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Tenant: tempest-TaggedAttachmentsTest-1745854352 Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Tenant-Id: fe8cdf0a5d7f49a9897167eb79dbfc39 Apr 14 10:47:11 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1745854352 Apr 14 10:47:11 user devstack@n-api.service[61841]: X-User: tempest-TaggedAttachmentsTest-1745854352-project-member Apr 14 10:47:11 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:47:11 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:47:11 user devstack@n-api.service[61841]: X-User-Id: c7ce31180e5946d4a027ae6ac9d136fa Apr 14 10:47:11 user devstack@n-api.service[61841]: X-User-Name: tempest-TaggedAttachmentsTest-1745854352-project-member Apr 14 10:47:11 user devstack@n-api.service[61841]: method: > Apr 14 10:47:11 user devstack@n-api.service[61841]: exception: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. Apr 14 10:47:11 user devstack@n-api.service[61841]: action_args: {'id': '31f6ad8c-40d3-4b6e-af07-4848fafc431d'} Apr 14 10:47:11 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. Apr 14 10:47:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:47:11 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9586380a-5ba8-44fd-9b0f-67dff25e8b17 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Returning 404 to user: Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:47:11 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-9586380a-5ba8-44fd-9b0f-67dff25e8b17 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d" status: 404 len: 111 microversion: 2.49 time: 0.049295 Apr 14 10:47:11 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 113/327] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:47:11 2023] GET /compute/v2.1/servers/31f6ad8c-40d3-4b6e-af07-4848fafc431d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:47:12 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c62fdeff-84d5-4e35-9383-8548f12a402d"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:12 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:13 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "POST /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.471097 Apr 14 10:47:13 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 108/328] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:47:12 2023] POST /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments => generated 194 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:19 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8d76e5b8-b3c0-4a57-a867-2983d70833cb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:19 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-8d76e5b8-b3c0-4a57-a867-2983d70833cb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:19 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=14 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d76e5b8-b3c0-4a57-a867-2983d70833cb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d76e5b8-b3c0-4a57-a867-2983d70833cb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d76e5b8-b3c0-4a57-a867-2983d70833cb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d76e5b8-b3c0-4a57-a867-2983d70833cb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d76e5b8-b3c0-4a57-a867-2983d70833cb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d76e5b8-b3c0-4a57-a867-2983d70833cb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:19 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=26 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:20 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-8d76e5b8-b3c0-4a57-a867-2983d70833cb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:47:20 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-8d76e5b8-b3c0-4a57-a867-2983d70833cb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:47:20 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-8d76e5b8-b3c0-4a57-a867-2983d70833cb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:47:20 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-8d76e5b8-b3c0-4a57-a867-2983d70833cb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07" status: 200 len: 1690 microversion: 2.87 time: 0.300550 Apr 14 10:47:20 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 108/329] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:47:19 2023] GET /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07 => generated 1690 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:47:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-53721f90-ac8c-4126-85c6-3dce9f6fc19f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d1cd2d0>, body: {"keypair": {"name": "tempest-keypair-1352311307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8cubhYj6kalSkwto2AOwwQ8SwXu5MQ/cjSK0TQBgPs7qiNcfKtpFOEItZcvi+VTwGeXlKnu4SiqcBNrbUUIw9hxThGtWyniX5k6WeMBHziH1L0bIiIvkr1gDZ6mYbTMQ=="}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:21 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=26 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:21 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-53721f90-ac8c-4126-85c6-3dce9f6fc19f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting quotas for project eb9b9fc4f2e244879502006bb844761c. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:47:21 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-53721f90-ac8c-4126-85c6-3dce9f6fc19f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting quotas for user 11cb4a1e78d447dbb18cde5453fe499c and project eb9b9fc4f2e244879502006bb844761c. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:47:21 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-53721f90-ac8c-4126-85c6-3dce9f6fc19f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.338616 Apr 14 10:47:21 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 114/330] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 10:47:21 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:22 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:22 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:22 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:22 user devstack@n-api.service[61840]: DEBUG nova.objects.instance [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'services' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=61840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:47:22 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments/c62fdeff-84d5-4e35-9383-8548f12a402d" status: 202 len: 0 microversion: 2.1 time: 0.221926 Apr 14 10:47:22 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 109/331] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:47:22 2023] DELETE /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments/c62fdeff-84d5-4e35-9383-8548f12a402d => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:47:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-46e3321e-142e-4f3e-8278-d18ade771cd9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:22 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-46e3321e-142e-4f3e-8278-d18ade771cd9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-46e3321e-142e-4f3e-8278-d18ade771cd9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-46e3321e-142e-4f3e-8278-d18ade771cd9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-46e3321e-142e-4f3e-8278-d18ade771cd9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-46e3321e-142e-4f3e-8278-d18ade771cd9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-46e3321e-142e-4f3e-8278-d18ade771cd9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-46e3321e-142e-4f3e-8278-d18ade771cd9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:22 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-46e3321e-142e-4f3e-8278-d18ade771cd9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061677 Apr 14 10:47:22 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 109/332] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:47:22 2023] GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:23 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:23 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1909620947", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "653f0c81-1afd-4ca6-9639-675ead1a6127"}], "security_groups": [{"name": "tempest-securitygroup--264299287"}], "key_name": "tempest-keypair-1352311307", "user_data": "}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:23 user devstack@n-api.service[61841]: DEBUG nova.network.neutron [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] validate_networks() for [('653f0c81-1afd-4ca6-9639-675ead1a6127', None, None, None, None, None)] {{(pid=61841) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:47:24 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flavor limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:47:24 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Image limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:47:24 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flavor pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:47:24 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Image pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:47:24 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:47:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:24 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting quotas for project eb9b9fc4f2e244879502006bb844761c. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:47:24 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting quotas for user 11cb4a1e78d447dbb18cde5453fe499c and project eb9b9fc4f2e244879502006bb844761c. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:47:24 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Going to run 1 instances... {{(pid=61841) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:47:24 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61841) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:47:24 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.854900 Apr 14 10:47:24 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 115/333] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:47:23 2023] POST /compute/v2.1/servers => generated 399 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:47:24 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-a0a2a8ad-12e2-4905-9c22-a271cfb2b013 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:24 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-a0a2a8ad-12e2-4905-9c22-a271cfb2b013 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:24 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-a0a2a8ad-12e2-4905-9c22-a271cfb2b013 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:47:24 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-a0a2a8ad-12e2-4905-9c22-a271cfb2b013 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871" status: 200 len: 1232 microversion: 2.1 time: 0.092404 Apr 14 10:47:24 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 110/334] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:47:24 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 => generated 1232 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:47:27 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:27 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:27 user devstack@n-api.service[61839]: DEBUG nova.objects.instance [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'flavor' on Instance uuid 97f20661-8b60-439e-b7af-2fc2013c5ade {{(pid=61839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:47:27 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "POST /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade/action" status: 200 len: 32 microversion: 2.1 time: 0.113334 Apr 14 10:47:27 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 110/335] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:47:27 2023] POST /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade/action => generated 32 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:47:27 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-60118678-7cc7-4d87-ad34-6abe0b8f4f6f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:27 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-60118678-7cc7-4d87-ad34-6abe0b8f4f6f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-60118678-7cc7-4d87-ad34-6abe0b8f4f6f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-60118678-7cc7-4d87-ad34-6abe0b8f4f6f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-60118678-7cc7-4d87-ad34-6abe0b8f4f6f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-60118678-7cc7-4d87-ad34-6abe0b8f4f6f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-60118678-7cc7-4d87-ad34-6abe0b8f4f6f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-60118678-7cc7-4d87-ad34-6abe0b8f4f6f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:27 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-60118678-7cc7-4d87-ad34-6abe0b8f4f6f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:47:27 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-60118678-7cc7-4d87-ad34-6abe0b8f4f6f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade" status: 200 len: 1509 microversion: 2.1 time: 0.440483 Apr 14 10:47:27 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 116/336] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:47:27 2023] GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade => generated 1509 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:47:28 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-119c683a-9b6d-41fd-8682-33568c40e209 req-66466de0-7924-44be-827a-6281ac23c4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8586a70e-9855-4177-ac1b-cf707a4df871", "tag": "473d9af8-25a0-4e5a-9afb-7a0c843115cc"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-119c683a-9b6d-41fd-8682-33568c40e209 req-66466de0-7924-44be-827a-6281ac23c4c7 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-119c683a-9b6d-41fd-8682-33568c40e209 req-66466de0-7924-44be-827a-6281ac23c4c7 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-119c683a-9b6d-41fd-8682-33568c40e209 req-66466de0-7924-44be-827a-6281ac23c4c7 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:28 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-119c683a-9b6d-41fd-8682-33568c40e209 req-66466de0-7924-44be-827a-6281ac23c4c7 service nova] Creating event network-changed:473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance 8586a70e-9855-4177-ac1b-cf707a4df871 on user Apr 14 10:47:28 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-119c683a-9b6d-41fd-8682-33568c40e209 req-66466de0-7924-44be-827a-6281ac23c4c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041334 Apr 14 10:47:28 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 111/337] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:29 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:29 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:29 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61839) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 10:47:29 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 10.0.0.210 "POST /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606/action" status: 202 len: 0 microversion: 2.1 time: 0.162793 Apr 14 10:47:29 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 111/338] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:47:29 2023] POST /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:47:29 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-62a68f45-81e3-4411-8405-b050d9674955 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:29 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-62a68f45-81e3-4411-8405-b050d9674955 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-62a68f45-81e3-4411-8405-b050d9674955 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-62a68f45-81e3-4411-8405-b050d9674955 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-62a68f45-81e3-4411-8405-b050d9674955 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-62a68f45-81e3-4411-8405-b050d9674955 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-62a68f45-81e3-4411-8405-b050d9674955 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-62a68f45-81e3-4411-8405-b050d9674955 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:29 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-62a68f45-81e3-4411-8405-b050d9674955 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c4ab86a8d244c4be5889b4ac47561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e1e1695464eb5ad8a8c881cf24611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:47:29 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-62a68f45-81e3-4411-8405-b050d9674955 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606" status: 200 len: 1506 microversion: 2.1 time: 0.238093 Apr 14 10:47:29 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 117/339] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:47:29 2023] GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:47:30 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-unplugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}, {"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-plugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}, {"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-plugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}, {"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-plugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}, {"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-unplugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:30 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Creating event network-vif-unplugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:47:30 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Creating event network-vif-plugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:47:30 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Creating event network-vif-plugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:47:30 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Creating event network-vif-plugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:47:30 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Creating event network-vif-unplugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:47:30 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.040643 Apr 14 10:47:30 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 112/340] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:30 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:31 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-e37cbb3e-23bc-4322-a796-824db8fa1ceb tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:31 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-e37cbb3e-23bc-4322-a796-824db8fa1ceb tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:31 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e37cbb3e-23bc-4322-a796-824db8fa1ceb tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:31 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e37cbb3e-23bc-4322-a796-824db8fa1ceb tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:31 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e37cbb3e-23bc-4322-a796-824db8fa1ceb tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:31 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e37cbb3e-23bc-4322-a796-824db8fa1ceb tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:31 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e37cbb3e-23bc-4322-a796-824db8fa1ceb tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:31 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e37cbb3e-23bc-4322-a796-824db8fa1ceb tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:31 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-e37cbb3e-23bc-4322-a796-824db8fa1ceb tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] HTTP exception thrown: Instance d6f539d8-4144-467b-ac69-44011c5b3564 could not be found. Apr 14 10:47:31 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-e37cbb3e-23bc-4322-a796-824db8fa1ceb tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Request method failure captured: Apr 14 10:47:31 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564 HTTP/1.1 Apr 14 10:47:31 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:47:31 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:47:31 user devstack@n-api.service[61839]: Connection: close Apr 14 10:47:31 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:47:31 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:47:31 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:47:31 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:47:31 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:47:31 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS4kWye1NOs936WBLvDGAJYv06GLkEosk3uKe90FHoUatSU_U8wNfLd0hsyCsL7PsiXy2o31uVRLmEsrLwluM7Wtb36oOnF5XI6OKeULufLwFRqB3GtdeiyTcWy2JhmNLlmVqHPUS5tP5ZIA2Hv_1FUhsyFez_SRCMlOw-h31eQLLIk Apr 14 10:47:31 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:47:31 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:47:31 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:47:31 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:47:31 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:47:31 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:47:31 user devstack@n-api.service[61839]: X-Project-Id: 64094cc814374da59456a39ef9cd8cd2 Apr 14 10:47:31 user devstack@n-api.service[61839]: X-Project-Name: tempest-TestVolumeSwap-2101147705 Apr 14 10:47:31 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:47:31 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:47:31 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64094cc814374da59456a39ef9cd8cd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/64094cc814374da59456a39ef9cd8cd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/64094cc814374da59456a39ef9cd8cd2"}]}] Apr 14 10:47:31 user devstack@n-api.service[61839]: X-Tenant: tempest-TestVolumeSwap-2101147705 Apr 14 10:47:31 user devstack@n-api.service[61839]: X-Tenant-Id: 64094cc814374da59456a39ef9cd8cd2 Apr 14 10:47:31 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-TestVolumeSwap-2101147705 Apr 14 10:47:31 user devstack@n-api.service[61839]: X-User: tempest-TestVolumeSwap-2101147705-project-member Apr 14 10:47:31 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:47:31 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:47:31 user devstack@n-api.service[61839]: X-User-Id: e15c150540fa4d9c825a9ac81d674308 Apr 14 10:47:31 user devstack@n-api.service[61839]: X-User-Name: tempest-TestVolumeSwap-2101147705-project-member Apr 14 10:47:31 user devstack@n-api.service[61839]: method: > Apr 14 10:47:31 user devstack@n-api.service[61839]: exception: Instance d6f539d8-4144-467b-ac69-44011c5b3564 could not be found. Apr 14 10:47:31 user devstack@n-api.service[61839]: action_args: {'id': 'd6f539d8-4144-467b-ac69-44011c5b3564'} Apr 14 10:47:31 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f539d8-4144-467b-ac69-44011c5b3564 could not be found. Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f539d8-4144-467b-ac69-44011c5b3564 could not be found. Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f539d8-4144-467b-ac69-44011c5b3564 could not be found. Apr 14 10:47:31 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:47:31 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-e37cbb3e-23bc-4322-a796-824db8fa1ceb tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Returning 404 to user: Instance d6f539d8-4144-467b-ac69-44011c5b3564 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:47:31 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-e37cbb3e-23bc-4322-a796-824db8fa1ceb tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564" status: 404 len: 111 microversion: 2.1 time: 0.033973 Apr 14 10:47:31 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 112/341] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:47:31 2023] GET /compute/v2.1/servers/d6f539d8-4144-467b-ac69-44011c5b3564 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 10:47:31 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-03d44a91-35cc-4797-bf29-1981d2a512d5 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Calling method '.version_select at 0x7fcd1d1ce9e0>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:31 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-03d44a91-35cc-4797-bf29-1981d2a512d5 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1731536774" status: 202 len: 0 microversion: 2.1 time: 0.033797 Apr 14 10:47:31 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 118/342] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 10:47:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1731536774 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:47:31 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-90fd2b0a-0ad3-4821-9039-f0776b1fe5ac req-dc990553-17aa-4a2a-8652-0d25ee76ebb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8586a70e-9855-4177-ac1b-cf707a4df871", "name": "network-vif-plugged", "status": "completed", "tag": "473d9af8-25a0-4e5a-9afb-7a0c843115cc"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-90fd2b0a-0ad3-4821-9039-f0776b1fe5ac req-dc990553-17aa-4a2a-8652-0d25ee76ebb2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-90fd2b0a-0ad3-4821-9039-f0776b1fe5ac req-dc990553-17aa-4a2a-8652-0d25ee76ebb2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-90fd2b0a-0ad3-4821-9039-f0776b1fe5ac req-dc990553-17aa-4a2a-8652-0d25ee76ebb2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-90fd2b0a-0ad3-4821-9039-f0776b1fe5ac req-dc990553-17aa-4a2a-8652-0d25ee76ebb2 service nova] Creating event network-vif-plugged:473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance 8586a70e-9855-4177-ac1b-cf707a4df871 on user Apr 14 10:47:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-90fd2b0a-0ad3-4821-9039-f0776b1fe5ac req-dc990553-17aa-4a2a-8652-0d25ee76ebb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039314 Apr 14 10:47:32 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 113/343] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:32 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-plugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}, {"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-plugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:32 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] Creating event network-vif-plugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:47:32 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] Creating event network-vif-plugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:47:32 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052138 Apr 14 10:47:32 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 113/344] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:34 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-12e7e42a-8a85-4c3f-b4be-03c875200c89 req-fadcda7d-3578-477f-a6aa-253aa8b17bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8586a70e-9855-4177-ac1b-cf707a4df871", "name": "network-vif-plugged", "status": "completed", "tag": "473d9af8-25a0-4e5a-9afb-7a0c843115cc"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-12e7e42a-8a85-4c3f-b4be-03c875200c89 req-fadcda7d-3578-477f-a6aa-253aa8b17bd9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-12e7e42a-8a85-4c3f-b4be-03c875200c89 req-fadcda7d-3578-477f-a6aa-253aa8b17bd9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-12e7e42a-8a85-4c3f-b4be-03c875200c89 req-fadcda7d-3578-477f-a6aa-253aa8b17bd9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:34 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-12e7e42a-8a85-4c3f-b4be-03c875200c89 req-fadcda7d-3578-477f-a6aa-253aa8b17bd9 service nova] Creating event network-vif-plugged:473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance 8586a70e-9855-4177-ac1b-cf707a4df871 on user Apr 14 10:47:34 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-12e7e42a-8a85-4c3f-b4be-03c875200c89 req-fadcda7d-3578-477f-a6aa-253aa8b17bd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044952 Apr 14 10:47:34 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 119/345] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:34 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-c744ade3-37ac-4aa1-8072-c53febd796b0 req-dc379306-1065-44b7-a335-76a547074f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-plugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-c744ade3-37ac-4aa1-8072-c53febd796b0 req-dc379306-1065-44b7-a335-76a547074f1e service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-c744ade3-37ac-4aa1-8072-c53febd796b0 req-dc379306-1065-44b7-a335-76a547074f1e service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-c744ade3-37ac-4aa1-8072-c53febd796b0 req-dc379306-1065-44b7-a335-76a547074f1e service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-c744ade3-37ac-4aa1-8072-c53febd796b0 req-dc379306-1065-44b7-a335-76a547074f1e service nova] Creating event network-vif-plugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:47:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-c744ade3-37ac-4aa1-8072-c53febd796b0 req-dc379306-1065-44b7-a335-76a547074f1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053316 Apr 14 10:47:34 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 114/346] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:37 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-942407433", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "networks": [{"uuid": "4efde76c-8493-4902-a655-f10faee002a4"}]}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:38 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:38 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=10 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:38 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9dad62f7-8f1a-48d2-8346-c9b6bb8fca7d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:38 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-9dad62f7-8f1a-48d2-8346-c9b6bb8fca7d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9dad62f7-8f1a-48d2-8346-c9b6bb8fca7d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9dad62f7-8f1a-48d2-8346-c9b6bb8fca7d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9dad62f7-8f1a-48d2-8346-c9b6bb8fca7d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9dad62f7-8f1a-48d2-8346-c9b6bb8fca7d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] validate_networks() for [('4efde76c-8493-4902-a655-f10faee002a4', None, None, None, None, None)] {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:47:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9dad62f7-8f1a-48d2-8346-c9b6bb8fca7d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9dad62f7-8f1a-48d2-8346-c9b6bb8fca7d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:38 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-9dad62f7-8f1a-48d2-8346-c9b6bb8fca7d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:47:38 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-9dad62f7-8f1a-48d2-8346-c9b6bb8fca7d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1722 microversion: 2.1 time: 0.257666 Apr 14 10:47:38 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 120/347] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:47:38 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:47:38 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:38 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-49fecfb9-ef96-49ca-85d6-c8a88527b9f1 req-8503e752-f72f-4e4e-88c9-589886d173a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39586d44-1d8e-4607-ab4d-c03a7d841606", "tag": "6099437e-5607-4a06-abcb-15d465c7ecf8"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-49fecfb9-ef96-49ca-85d6-c8a88527b9f1 req-8503e752-f72f-4e4e-88c9-589886d173a1 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-49fecfb9-ef96-49ca-85d6-c8a88527b9f1 req-8503e752-f72f-4e4e-88c9-589886d173a1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-49fecfb9-ef96-49ca-85d6-c8a88527b9f1 req-8503e752-f72f-4e4e-88c9-589886d173a1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:38 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-49fecfb9-ef96-49ca-85d6-c8a88527b9f1 req-8503e752-f72f-4e4e-88c9-589886d173a1 service nova] Creating event network-changed:6099437e-5607-4a06-abcb-15d465c7ecf8 for instance 39586d44-1d8e-4607-ab4d-c03a7d841606 on user Apr 14 10:47:38 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-49fecfb9-ef96-49ca-85d6-c8a88527b9f1 req-8503e752-f72f-4e4e-88c9-589886d173a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058995 Apr 14 10:47:38 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 115/348] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Getting quotas for project a84a2fac4604454982dc018b36440b00. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Getting quotas for user ac498c56dae543cf9e64fbb61ad50df3 and project a84a2fac4604454982dc018b36440b00. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:47:38 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:47:38 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.961827 Apr 14 10:47:38 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 114/349] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:47:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:47:38 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-771fb749-41d1-4b00-a894-144baa9b6419 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:38 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-771fb749-41d1-4b00-a894-144baa9b6419 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:38 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-771fb749-41d1-4b00-a894-144baa9b6419 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac498c56dae543cf9e64fbb61ad50df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84a2fac4604454982dc018b36440b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:47:38 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-771fb749-41d1-4b00-a894-144baa9b6419 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" status: 200 len: 1212 microversion: 2.1 time: 0.093174 Apr 14 10:47:38 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 121/350] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:47:38 2023] GET /compute/v2.1/servers/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 => generated 1212 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:47:42 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-cfd29a64-fc0b-4bfc-b619-77bf488ca614 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:42 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-cfd29a64-fc0b-4bfc-b619-77bf488ca614 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cfd29a64-fc0b-4bfc-b619-77bf488ca614 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cfd29a64-fc0b-4bfc-b619-77bf488ca614 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cfd29a64-fc0b-4bfc-b619-77bf488ca614 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cfd29a64-fc0b-4bfc-b619-77bf488ca614 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cfd29a64-fc0b-4bfc-b619-77bf488ca614 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cfd29a64-fc0b-4bfc-b619-77bf488ca614 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:42 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-cfd29a64-fc0b-4bfc-b619-77bf488ca614 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7212c3fe50ef465c99a0eefec4cbd753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482809b9148e408b84b156802a21a225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:47:42 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-cfd29a64-fc0b-4bfc-b619-77bf488ca614 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce" status: 200 len: 1703 microversion: 2.1 time: 0.321774 Apr 14 10:47:42 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 116/351] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:47:42 2023] GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce => generated 1703 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:47:43 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-207045a8-ba8b-42c0-aec5-0ed173f6d3fe req-3e00c79e-a348-4a28-9a3e-d3effb3fb8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108", "tag": "01a9c136-4a03-464b-bc37-e95ab62f6f1a"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-207045a8-ba8b-42c0-aec5-0ed173f6d3fe req-3e00c79e-a348-4a28-9a3e-d3effb3fb8e5 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-207045a8-ba8b-42c0-aec5-0ed173f6d3fe req-3e00c79e-a348-4a28-9a3e-d3effb3fb8e5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-207045a8-ba8b-42c0-aec5-0ed173f6d3fe req-3e00c79e-a348-4a28-9a3e-d3effb3fb8e5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:43 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-207045a8-ba8b-42c0-aec5-0ed173f6d3fe req-3e00c79e-a348-4a28-9a3e-d3effb3fb8e5 service nova] Creating event network-changed:01a9c136-4a03-464b-bc37-e95ab62f6f1a for instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 on user Apr 14 10:47:43 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-207045a8-ba8b-42c0-aec5-0ed173f6d3fe req-3e00c79e-a348-4a28-9a3e-d3effb3fb8e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071081 Apr 14 10:47:43 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 115/352] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:45 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39586d44-1d8e-4607-ab4d-c03a7d841606", "name": "network-vif-plugged", "status": "completed", "tag": "6099437e-5607-4a06-abcb-15d465c7ecf8"}, {"server_uuid": "39586d44-1d8e-4607-ab4d-c03a7d841606", "name": "network-vif-plugged", "status": "completed", "tag": "6099437e-5607-4a06-abcb-15d465c7ecf8"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:45 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] Creating event network-vif-plugged:6099437e-5607-4a06-abcb-15d465c7ecf8 for instance 39586d44-1d8e-4607-ab4d-c03a7d841606 on user Apr 14 10:47:45 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] Creating event network-vif-plugged:6099437e-5607-4a06-abcb-15d465c7ecf8 for instance 39586d44-1d8e-4607-ab4d-c03a7d841606 on user Apr 14 10:47:45 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063849 Apr 14 10:47:45 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 122/353] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:46 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-6156a96a-1742-4404-a1b9-61f770f694ee tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:46 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-6156a96a-1742-4404-a1b9-61f770f694ee tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6156a96a-1742-4404-a1b9-61f770f694ee tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6156a96a-1742-4404-a1b9-61f770f694ee tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6156a96a-1742-4404-a1b9-61f770f694ee tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6156a96a-1742-4404-a1b9-61f770f694ee tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6156a96a-1742-4404-a1b9-61f770f694ee tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6156a96a-1742-4404-a1b9-61f770f694ee tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:47 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-6156a96a-1742-4404-a1b9-61f770f694ee tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.290524 Apr 14 10:47:47 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 117/354] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 10:47:46 2023] GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/os-interface => generated 283 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:47:47 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-1a52c538-a62f-409c-a2d5-beebb2833b19 req-820696e0-31e9-402a-9177-117a3abefce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108", "name": "network-vif-plugged", "status": "completed", "tag": "01a9c136-4a03-464b-bc37-e95ab62f6f1a"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1a52c538-a62f-409c-a2d5-beebb2833b19 req-820696e0-31e9-402a-9177-117a3abefce1 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1a52c538-a62f-409c-a2d5-beebb2833b19 req-820696e0-31e9-402a-9177-117a3abefce1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1a52c538-a62f-409c-a2d5-beebb2833b19 req-820696e0-31e9-402a-9177-117a3abefce1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:47 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-1a52c538-a62f-409c-a2d5-beebb2833b19 req-820696e0-31e9-402a-9177-117a3abefce1 service nova] Creating event network-vif-plugged:01a9c136-4a03-464b-bc37-e95ab62f6f1a for instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 on user Apr 14 10:47:47 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-1a52c538-a62f-409c-a2d5-beebb2833b19 req-820696e0-31e9-402a-9177-117a3abefce1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046314 Apr 14 10:47:47 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 116/355] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:48 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-f44b6de2-85dd-41f0-a820-a979481eda0d tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:48 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-f44b6de2-85dd-41f0-a820-a979481eda0d tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f44b6de2-85dd-41f0-a820-a979481eda0d tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f44b6de2-85dd-41f0-a820-a979481eda0d tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f44b6de2-85dd-41f0-a820-a979481eda0d tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f44b6de2-85dd-41f0-a820-a979481eda0d tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f44b6de2-85dd-41f0-a820-a979481eda0d tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f44b6de2-85dd-41f0-a820-a979481eda0d tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:48 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-f44b6de2-85dd-41f0-a820-a979481eda0d tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/ips" status: 200 len: 111 microversion: 2.20 time: 0.054406 Apr 14 10:47:48 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 123/356] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 10:47:48 2023] GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/ips => generated 111 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:47:49 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108", "name": "network-vif-plugged", "status": "completed", "tag": "01a9c136-4a03-464b-bc37-e95ab62f6f1a"}, {"name": "network-changed", "server_uuid": "4b767f1b-e97e-497c-8c70-8806203c76ae", "tag": "8d8a356d-c198-4e13-a489-5c626fbd025c"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] Creating event network-vif-plugged:01a9c136-4a03-464b-bc37-e95ab62f6f1a for instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 on user Apr 14 10:47:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] Creating event network-changed:8d8a356d-c198-4e13-a489-5c626fbd025c for instance 4b767f1b-e97e-497c-8c70-8806203c76ae on user Apr 14 10:47:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.069589 Apr 14 10:47:49 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 118/357] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:49 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:51 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:51 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:51 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:51 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:51 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:51 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:51 user devstack@n-api.service[61839]: DEBUG nova.objects.instance [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'flavor' on Instance uuid 4b767f1b-e97e-497c-8c70-8806203c76ae {{(pid=61839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:47:52 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/action" status: 202 len: 0 microversion: 2.20 time: 1.132314 Apr 14 10:47:52 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 117/358] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 10:47:51 2023] POST /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:47:52 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9c59273f-64be-4f49-8983-46324d5111ca tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:47:52 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-9c59273f-64be-4f49-8983-46324d5111ca tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:47:52 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:52 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9c59273f-64be-4f49-8983-46324d5111ca tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9c59273f-64be-4f49-8983-46324d5111ca tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9c59273f-64be-4f49-8983-46324d5111ca tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9c59273f-64be-4f49-8983-46324d5111ca tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9c59273f-64be-4f49-8983-46324d5111ca tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9c59273f-64be-4f49-8983-46324d5111ca tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:52 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-9c59273f-64be-4f49-8983-46324d5111ca tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:47:52 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-9c59273f-64be-4f49-8983-46324d5111ca tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:47:52 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-9c59273f-64be-4f49-8983-46324d5111ca tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:47:52 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-9c59273f-64be-4f49-8983-46324d5111ca tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae" status: 200 len: 1712 microversion: 2.20 time: 0.259659 Apr 14 10:47:52 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 124/359] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:47:52 2023] GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae => generated 1712 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:47:53 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-416acc21-0680-4a0b-9e9c-bc401580570e req-e19831c4-35cb-4579-9031-5735bef3137a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b767f1b-e97e-497c-8c70-8806203c76ae", "name": "network-vif-unplugged", "status": "completed", "tag": "8d8a356d-c198-4e13-a489-5c626fbd025c"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:53 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=22 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-416acc21-0680-4a0b-9e9c-bc401580570e req-e19831c4-35cb-4579-9031-5735bef3137a service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-416acc21-0680-4a0b-9e9c-bc401580570e req-e19831c4-35cb-4579-9031-5735bef3137a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-416acc21-0680-4a0b-9e9c-bc401580570e req-e19831c4-35cb-4579-9031-5735bef3137a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:53 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-416acc21-0680-4a0b-9e9c-bc401580570e req-e19831c4-35cb-4579-9031-5735bef3137a service nova] Creating event network-vif-unplugged:8d8a356d-c198-4e13-a489-5c626fbd025c for instance 4b767f1b-e97e-497c-8c70-8806203c76ae on user Apr 14 10:47:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-416acc21-0680-4a0b-9e9c-bc401580570e req-e19831c4-35cb-4579-9031-5735bef3137a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.261009 Apr 14 10:47:53 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 119/360] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:47:55 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-2c97cba6-17ef-4fc1-a4e4-ce6282a74dc1 req-8b76026c-3d63-4122-9c7d-a38e8a394873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b767f1b-e97e-497c-8c70-8806203c76ae", "name": "network-vif-plugged", "status": "completed", "tag": "8d8a356d-c198-4e13-a489-5c626fbd025c"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2c97cba6-17ef-4fc1-a4e4-ce6282a74dc1 req-8b76026c-3d63-4122-9c7d-a38e8a394873 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2c97cba6-17ef-4fc1-a4e4-ce6282a74dc1 req-8b76026c-3d63-4122-9c7d-a38e8a394873 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2c97cba6-17ef-4fc1-a4e4-ce6282a74dc1 req-8b76026c-3d63-4122-9c7d-a38e8a394873 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:55 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-2c97cba6-17ef-4fc1-a4e4-ce6282a74dc1 req-8b76026c-3d63-4122-9c7d-a38e8a394873 service nova] Creating event network-vif-plugged:8d8a356d-c198-4e13-a489-5c626fbd025c for instance 4b767f1b-e97e-497c-8c70-8806203c76ae on user Apr 14 10:47:55 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-2c97cba6-17ef-4fc1-a4e4-ce6282a74dc1 req-8b76026c-3d63-4122-9c7d-a38e8a394873 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037581 Apr 14 10:47:55 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 118/361] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:47:59 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-4d5e231d-3bd3-48fa-b3d7-85568e319b24 req-b8f0a6ff-ec3d-4f17-b960-8a88ecfea41c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b767f1b-e97e-497c-8c70-8806203c76ae", "tag": "8d8a356d-c198-4e13-a489-5c626fbd025c"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:47:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-4d5e231d-3bd3-48fa-b3d7-85568e319b24 req-b8f0a6ff-ec3d-4f17-b960-8a88ecfea41c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:47:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-4d5e231d-3bd3-48fa-b3d7-85568e319b24 req-b8f0a6ff-ec3d-4f17-b960-8a88ecfea41c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:47:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-4d5e231d-3bd3-48fa-b3d7-85568e319b24 req-b8f0a6ff-ec3d-4f17-b960-8a88ecfea41c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:47:59 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=35 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:47:59 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-4d5e231d-3bd3-48fa-b3d7-85568e319b24 req-b8f0a6ff-ec3d-4f17-b960-8a88ecfea41c service nova] Creating event network-changed:8d8a356d-c198-4e13-a489-5c626fbd025c for instance 4b767f1b-e97e-497c-8c70-8806203c76ae on user Apr 14 10:47:59 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-4d5e231d-3bd3-48fa-b3d7-85568e319b24 req-b8f0a6ff-ec3d-4f17-b960-8a88ecfea41c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190229 Apr 14 10:47:59 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 125/362] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:47:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:48:09 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:48:09 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:48:09 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-7401f4bb-286e-4ffd-b514-eafa38c73acb tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d1277f0>, body: {"keypair": {"name": "tempest-keypair-685259735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4n7cCmjQrFnx0jG2LyeLXh4VwIGx2PxO0+r8zAKj/Oj2f/50NTGIkyw35hqehB4Xb7vkg33UPXB0dq8gJQe8S7XSS6kQN94P7QD6GPEDoWU9GDCzvMWJoK2JE5ox6/6w=="}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:48:09 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-7401f4bb-286e-4ffd-b514-eafa38c73acb tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Getting quotas for project aca26975e5ad4524b4b1b1ec4335802f. Resources: {'key_pairs'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:48:09 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-7401f4bb-286e-4ffd-b514-eafa38c73acb tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Getting quotas for user 6adefa90332c42c79a1372258a7be5ab and project aca26975e5ad4524b4b1b1ec4335802f. Resources: {'key_pairs'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:48:09 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-7401f4bb-286e-4ffd-b514-eafa38c73acb tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.327927 Apr 14 10:48:09 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 120/363] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 10:48:09 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-186982469", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "networks": [{"uuid": "36ccc911-348d-426a-ba7b-a49a0bfb0f97"}], "security_groups": [{"name": "tempest-securitygroup--249746653"}], "key_name": "tempest-keypair-685259735", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=3 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] validate_networks() for [('36ccc911-348d-426a-ba7b-a49a0bfb0f97', None, None, None, None, None)] {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Getting quotas for project aca26975e5ad4524b4b1b1ec4335802f. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Getting quotas for user 6adefa90332c42c79a1372258a7be5ab and project aca26975e5ad4524b4b1b1ec4335802f. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:48:11 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:48:12 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.747165 Apr 14 10:48:12 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 119/364] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:48:11 2023] POST /compute/v2.1/servers => generated 403 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:48:12 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:48:12 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-cc581d14-db0f-4ba3-a51f-8789bca63f96 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:48:12 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-cc581d14-db0f-4ba3-a51f-8789bca63f96 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:12 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-cc581d14-db0f-4ba3-a51f-8789bca63f96 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6adefa90332c42c79a1372258a7be5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca26975e5ad4524b4b1b1ec4335802f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:48:12 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-cc581d14-db0f-4ba3-a51f-8789bca63f96 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9" status: 200 len: 1234 microversion: 2.1 time: 0.076106 Apr 14 10:48:12 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 126/365] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:48:12 2023] GET /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9 => generated 1234 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:48:12 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-2c00f3d8-5901-4dd5-9427-f1f88299c11b tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:48:12 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-2c00f3d8-5901-4dd5-9427-f1f88299c11b tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2c00f3d8-5901-4dd5-9427-f1f88299c11b tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2c00f3d8-5901-4dd5-9427-f1f88299c11b tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2c00f3d8-5901-4dd5-9427-f1f88299c11b tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2c00f3d8-5901-4dd5-9427-f1f88299c11b tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2c00f3d8-5901-4dd5-9427-f1f88299c11b tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2c00f3d8-5901-4dd5-9427-f1f88299c11b tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:12 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-2c00f3d8-5901-4dd5-9427-f1f88299c11b tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051733 Apr 14 10:48:12 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 121/366] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:48:12 2023] GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:48:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-7de1a3d5-ad7f-49ca-a60f-d9f3cdd7b20b tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:48:14 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-7de1a3d5-ad7f-49ca-a60f-d9f3cdd7b20b tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7de1a3d5-ad7f-49ca-a60f-d9f3cdd7b20b tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7de1a3d5-ad7f-49ca-a60f-d9f3cdd7b20b tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7de1a3d5-ad7f-49ca-a60f-d9f3cdd7b20b tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7de1a3d5-ad7f-49ca-a60f-d9f3cdd7b20b tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7de1a3d5-ad7f-49ca-a60f-d9f3cdd7b20b tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7de1a3d5-ad7f-49ca-a60f-d9f3cdd7b20b tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:15 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-b2c9e270-42d2-42fe-a72c-eaf1495822e1 req-e70d6ccc-797b-45a2-b4b6-66a17c51ede1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3245b74-dbe8-4b8b-83b6-58a4811fdba9", "tag": "9abeb28a-35f1-4e16-a152-ed2578e8a678"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:48:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-b2c9e270-42d2-42fe-a72c-eaf1495822e1 req-e70d6ccc-797b-45a2-b4b6-66a17c51ede1 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-b2c9e270-42d2-42fe-a72c-eaf1495822e1 req-e70d6ccc-797b-45a2-b4b6-66a17c51ede1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-b2c9e270-42d2-42fe-a72c-eaf1495822e1 req-e70d6ccc-797b-45a2-b4b6-66a17c51ede1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:15 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-b2c9e270-42d2-42fe-a72c-eaf1495822e1 req-e70d6ccc-797b-45a2-b4b6-66a17c51ede1 service nova] Creating event network-changed:9abeb28a-35f1-4e16-a152-ed2578e8a678 for instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 on user Apr 14 10:48:15 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-b2c9e270-42d2-42fe-a72c-eaf1495822e1 req-e70d6ccc-797b-45a2-b4b6-66a17c51ede1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037484 Apr 14 10:48:15 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 127/367] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:48:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:48:15 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-7de1a3d5-ad7f-49ca-a60f-d9f3cdd7b20b tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:48:15 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-7de1a3d5-ad7f-49ca-a60f-d9f3cdd7b20b tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871" status: 200 len: 1536 microversion: 2.1 time: 0.222382 Apr 14 10:48:15 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 120/368] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:48:14 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 => generated 1536 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:48:16 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa52f0fe-627e-4b45-aa2b-0c85864afcaf"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:48:16 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "POST /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290694 Apr 14 10:48:16 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 122/369] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:48:16 2023] POST /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:48:17 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-3b655055-4c37-4cd9-9eff-5876a0102f0f req-cc13c7b4-dbe5-4d82-9f2e-e2e7dd05cda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3245b74-dbe8-4b8b-83b6-58a4811fdba9", "name": "network-vif-plugged", "status": "completed", "tag": "9abeb28a-35f1-4e16-a152-ed2578e8a678"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:48:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-3b655055-4c37-4cd9-9eff-5876a0102f0f req-cc13c7b4-dbe5-4d82-9f2e-e2e7dd05cda6 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-3b655055-4c37-4cd9-9eff-5876a0102f0f req-cc13c7b4-dbe5-4d82-9f2e-e2e7dd05cda6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-3b655055-4c37-4cd9-9eff-5876a0102f0f req-cc13c7b4-dbe5-4d82-9f2e-e2e7dd05cda6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:17 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-3b655055-4c37-4cd9-9eff-5876a0102f0f req-cc13c7b4-dbe5-4d82-9f2e-e2e7dd05cda6 service nova] Creating event network-vif-plugged:9abeb28a-35f1-4e16-a152-ed2578e8a678 for instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 on user Apr 14 10:48:17 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-3b655055-4c37-4cd9-9eff-5876a0102f0f req-cc13c7b4-dbe5-4d82-9f2e-e2e7dd05cda6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.293248 Apr 14 10:48:17 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 128/370] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:48:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:48:17 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-4c82d65f-ba4c-4adf-86e5-abc67435f51c tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:48:17 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-4c82d65f-ba4c-4adf-86e5-abc67435f51c tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4c82d65f-ba4c-4adf-86e5-abc67435f51c tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4c82d65f-ba4c-4adf-86e5-abc67435f51c tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4c82d65f-ba4c-4adf-86e5-abc67435f51c tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4c82d65f-ba4c-4adf-86e5-abc67435f51c tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4c82d65f-ba4c-4adf-86e5-abc67435f51c tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4c82d65f-ba4c-4adf-86e5-abc67435f51c tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:18 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-4c82d65f-ba4c-4adf-86e5-abc67435f51c tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:48:18 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-4c82d65f-ba4c-4adf-86e5-abc67435f51c tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade" status: 200 len: 1489 microversion: 2.1 time: 0.433282 Apr 14 10:48:18 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 121/371] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:48:17 2023] GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade => generated 1489 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:48:19 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-e759d5b1-817f-42d8-bf55-a66c947028b8 req-8681a99a-4f3a-496a-9ed6-f4eec38b6507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3245b74-dbe8-4b8b-83b6-58a4811fdba9", "name": "network-vif-plugged", "status": "completed", "tag": "9abeb28a-35f1-4e16-a152-ed2578e8a678"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:48:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-e759d5b1-817f-42d8-bf55-a66c947028b8 req-8681a99a-4f3a-496a-9ed6-f4eec38b6507 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-e759d5b1-817f-42d8-bf55-a66c947028b8 req-8681a99a-4f3a-496a-9ed6-f4eec38b6507 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-e759d5b1-817f-42d8-bf55-a66c947028b8 req-8681a99a-4f3a-496a-9ed6-f4eec38b6507 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:19 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-e759d5b1-817f-42d8-bf55-a66c947028b8 req-8681a99a-4f3a-496a-9ed6-f4eec38b6507 service nova] Creating event network-vif-plugged:9abeb28a-35f1-4e16-a152-ed2578e8a678 for instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 on user Apr 14 10:48:19 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-e759d5b1-817f-42d8-bf55-a66c947028b8 req-8681a99a-4f3a-496a-9ed6-f4eec38b6507 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038358 Apr 14 10:48:19 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 123/372] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:48:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:48:19 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-21b7c340-57b2-4758-99b3-238b96092204 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:48:19 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-21b7c340-57b2-4758-99b3-238b96092204 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-21b7c340-57b2-4758-99b3-238b96092204 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-21b7c340-57b2-4758-99b3-238b96092204 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-21b7c340-57b2-4758-99b3-238b96092204 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-21b7c340-57b2-4758-99b3-238b96092204 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-21b7c340-57b2-4758-99b3-238b96092204 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-21b7c340-57b2-4758-99b3-238b96092204 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:20 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-21b7c340-57b2-4758-99b3-238b96092204 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c4ab86a8d244c4be5889b4ac47561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e1e1695464eb5ad8a8c881cf24611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:48:20 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-21b7c340-57b2-4758-99b3-238b96092204 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606" status: 200 len: 1551 microversion: 2.1 time: 0.192028 Apr 14 10:48:20 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 129/373] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:48:19 2023] GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606 => generated 1551 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:48:20 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-462699732"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:48:20 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:21 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07/action" status: 202 len: 52 microversion: 2.87 time: 0.830135 Apr 14 10:48:21 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 122/374] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 10:48:20 2023] POST /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07/action => generated 52 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 10:48:24 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:48:24 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:48:24 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:24 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:24 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:24 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:24 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:24 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:24 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:25 user devstack@n-api.service[61840]: DEBUG nova.objects.instance [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'services' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=61840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:48:25 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments/fa52f0fe-627e-4b45-aa2b-0c85864afcaf" status: 202 len: 0 microversion: 2.1 time: 0.175173 Apr 14 10:48:25 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 124/375] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:48:24 2023] DELETE /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments/fa52f0fe-627e-4b45-aa2b-0c85864afcaf => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:48:25 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-4429cea9-fc55-46b1-bfb7-78b30a41fdab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:48:25 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-4429cea9-fc55-46b1-bfb7-78b30a41fdab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:25 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:48:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4429cea9-fc55-46b1-bfb7-78b30a41fdab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4429cea9-fc55-46b1-bfb7-78b30a41fdab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4429cea9-fc55-46b1-bfb7-78b30a41fdab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4429cea9-fc55-46b1-bfb7-78b30a41fdab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4429cea9-fc55-46b1-bfb7-78b30a41fdab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4429cea9-fc55-46b1-bfb7-78b30a41fdab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:25 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-4429cea9-fc55-46b1-bfb7-78b30a41fdab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065922 Apr 14 10:48:25 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 130/376] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:48:25 2023] GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:48:26 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:48:26 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:48:26 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-1d6f63a5-8ca4-48de-8933-e9d611b88845 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:48:26 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-1d6f63a5-8ca4-48de-8933-e9d611b88845 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:26 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1d6f63a5-8ca4-48de-8933-e9d611b88845 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:26 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1d6f63a5-8ca4-48de-8933-e9d611b88845 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:26 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1d6f63a5-8ca4-48de-8933-e9d611b88845 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:26 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1d6f63a5-8ca4-48de-8933-e9d611b88845 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:26 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1d6f63a5-8ca4-48de-8933-e9d611b88845 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:26 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1d6f63a5-8ca4-48de-8933-e9d611b88845 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:26 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-1d6f63a5-8ca4-48de-8933-e9d611b88845 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:48:26 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-1d6f63a5-8ca4-48de-8933-e9d611b88845 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:48:26 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-1d6f63a5-8ca4-48de-8933-e9d611b88845 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:48:26 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-1d6f63a5-8ca4-48de-8933-e9d611b88845 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07" status: 200 len: 1703 microversion: 2.87 time: 0.186585 Apr 14 10:48:26 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 123/377] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:48:26 2023] GET /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07 => generated 1703 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:48:28 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-6aa77a82-176a-4a19-9f3e-bb8a4e300a44 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:48:28 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-6aa77a82-176a-4a19-9f3e-bb8a4e300a44 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6aa77a82-176a-4a19-9f3e-bb8a4e300a44 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6aa77a82-176a-4a19-9f3e-bb8a4e300a44 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6aa77a82-176a-4a19-9f3e-bb8a4e300a44 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6aa77a82-176a-4a19-9f3e-bb8a4e300a44 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6aa77a82-176a-4a19-9f3e-bb8a4e300a44 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6aa77a82-176a-4a19-9f3e-bb8a4e300a44 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:29 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-6aa77a82-176a-4a19-9f3e-bb8a4e300a44 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac498c56dae543cf9e64fbb61ad50df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84a2fac4604454982dc018b36440b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:48:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-6aa77a82-176a-4a19-9f3e-bb8a4e300a44 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" status: 200 len: 1496 microversion: 2.1 time: 0.165961 Apr 14 10:48:29 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 125/378] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:48:28 2023] GET /compute/v2.1/servers/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 => generated 1496 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:48:38 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=12 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:48:38 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=17 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:48:38 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-aeb89d6d-ba2d-431a-a2f7-64c40fa60118 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:48:38 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-aeb89d6d-ba2d-431a-a2f7-64c40fa60118 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aeb89d6d-ba2d-431a-a2f7-64c40fa60118 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aeb89d6d-ba2d-431a-a2f7-64c40fa60118 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aeb89d6d-ba2d-431a-a2f7-64c40fa60118 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aeb89d6d-ba2d-431a-a2f7-64c40fa60118 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aeb89d6d-ba2d-431a-a2f7-64c40fa60118 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aeb89d6d-ba2d-431a-a2f7-64c40fa60118 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:38 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-aeb89d6d-ba2d-431a-a2f7-64c40fa60118 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:48:38 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-aeb89d6d-ba2d-431a-a2f7-64c40fa60118 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1722 microversion: 2.1 time: 0.404612 Apr 14 10:48:38 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 131/379] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:48:38 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1722 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:48:38 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-841b79f6-6592-4b3e-9e8d-b581fc24e56a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:48:38 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-841b79f6-6592-4b3e-9e8d-b581fc24e56a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:38 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:48:38 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:48:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-841b79f6-6592-4b3e-9e8d-b581fc24e56a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-841b79f6-6592-4b3e-9e8d-b581fc24e56a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-841b79f6-6592-4b3e-9e8d-b581fc24e56a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-841b79f6-6592-4b3e-9e8d-b581fc24e56a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-841b79f6-6592-4b3e-9e8d-b581fc24e56a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-841b79f6-6592-4b3e-9e8d-b581fc24e56a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:39 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-841b79f6-6592-4b3e-9e8d-b581fc24e56a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:48:39 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-841b79f6-6592-4b3e-9e8d-b581fc24e56a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1722 microversion: 2.1 time: 0.152888 Apr 14 10:48:39 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 124/380] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:48:38 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:48:42 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:48:42 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:48:42 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a8d1fc7c-a3a6-43b1-884b-27c1b10521d3 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:48:42 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-a8d1fc7c-a3a6-43b1-884b-27c1b10521d3 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8d1fc7c-a3a6-43b1-884b-27c1b10521d3 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8d1fc7c-a3a6-43b1-884b-27c1b10521d3 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8d1fc7c-a3a6-43b1-884b-27c1b10521d3 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8d1fc7c-a3a6-43b1-884b-27c1b10521d3 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8d1fc7c-a3a6-43b1-884b-27c1b10521d3 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8d1fc7c-a3a6-43b1-884b-27c1b10521d3 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:42 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:48:42 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:42 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-a8d1fc7c-a3a6-43b1-884b-27c1b10521d3 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:48:42 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-a8d1fc7c-a3a6-43b1-884b-27c1b10521d3 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:48:42 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-a8d1fc7c-a3a6-43b1-884b-27c1b10521d3 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:48:42 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/action" status: 202 len: 0 microversion: 2.1 time: 0.200388 Apr 14 10:48:42 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a8d1fc7c-a3a6-43b1-884b-27c1b10521d3 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae" status: 200 len: 1653 microversion: 2.20 time: 0.174063 Apr 14 10:48:42 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 126/381] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:48:42 2023] POST /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:48:42 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 132/382] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:48:42 2023] GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae => generated 1653 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:48:43 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f3415ff4-b868-4a4a-928e-75279e23220c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:48:43 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-f3415ff4-b868-4a4a-928e-75279e23220c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:48:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f3415ff4-b868-4a4a-928e-75279e23220c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f3415ff4-b868-4a4a-928e-75279e23220c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f3415ff4-b868-4a4a-928e-75279e23220c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f3415ff4-b868-4a4a-928e-75279e23220c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f3415ff4-b868-4a4a-928e-75279e23220c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f3415ff4-b868-4a4a-928e-75279e23220c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:43 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-f3415ff4-b868-4a4a-928e-75279e23220c tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.118280 Apr 14 10:48:43 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 125/383] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 10:48:43 2023] GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/os-interface => generated 283 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:48:44 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-3ac766d7-0c41-4c50-9251-bc332ed25ca6 req-df7fb19c-d20d-4317-9afb-9c6c48cfd414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:48:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-3ac766d7-0c41-4c50-9251-bc332ed25ca6 req-df7fb19c-d20d-4317-9afb-9c6c48cfd414 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-3ac766d7-0c41-4c50-9251-bc332ed25ca6 req-df7fb19c-d20d-4317-9afb-9c6c48cfd414 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-3ac766d7-0c41-4c50-9251-bc332ed25ca6 req-df7fb19c-d20d-4317-9afb-9c6c48cfd414 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-3ac766d7-0c41-4c50-9251-bc332ed25ca6 req-df7fb19c-d20d-4317-9afb-9c6c48cfd414 service nova] Creating event network-changed:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:48:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-3ac766d7-0c41-4c50-9251-bc332ed25ca6 req-df7fb19c-d20d-4317-9afb-9c6c48cfd414 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047836 Apr 14 10:48:44 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 127/384] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:48:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:48:44 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-50716bde-b6c8-4760-aa04-36af06c4bc41 req-b5947834-5b13-4bc7-b2f3-df40a5ee9bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "name": "network-vif-unplugged", "status": "completed", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:48:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-50716bde-b6c8-4760-aa04-36af06c4bc41 req-b5947834-5b13-4bc7-b2f3-df40a5ee9bd5 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-50716bde-b6c8-4760-aa04-36af06c4bc41 req-b5947834-5b13-4bc7-b2f3-df40a5ee9bd5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-50716bde-b6c8-4760-aa04-36af06c4bc41 req-b5947834-5b13-4bc7-b2f3-df40a5ee9bd5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:44 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-50716bde-b6c8-4760-aa04-36af06c4bc41 req-b5947834-5b13-4bc7-b2f3-df40a5ee9bd5 service nova] Creating event network-vif-unplugged:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:48:44 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-50716bde-b6c8-4760-aa04-36af06c4bc41 req-b5947834-5b13-4bc7-b2f3-df40a5ee9bd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039562 Apr 14 10:48:44 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 133/385] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:48:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:48:46 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-1929364d-8316-44dc-9c3e-4dfb01f55793 req-2079ff8e-da65-43ef-9078-149fd6e9d70f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:48:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1929364d-8316-44dc-9c3e-4dfb01f55793 req-2079ff8e-da65-43ef-9078-149fd6e9d70f service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1929364d-8316-44dc-9c3e-4dfb01f55793 req-2079ff8e-da65-43ef-9078-149fd6e9d70f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1929364d-8316-44dc-9c3e-4dfb01f55793 req-2079ff8e-da65-43ef-9078-149fd6e9d70f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-1929364d-8316-44dc-9c3e-4dfb01f55793 req-2079ff8e-da65-43ef-9078-149fd6e9d70f service nova] Creating event network-changed:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:48:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-1929364d-8316-44dc-9c3e-4dfb01f55793 req-2079ff8e-da65-43ef-9078-149fd6e9d70f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031834 Apr 14 10:48:46 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 126/386] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:48:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:48:46 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "name": "network-vif-plugged", "status": "completed", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}, {"server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "name": "network-vif-plugged", "status": "completed", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:48:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:46 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] Creating event network-vif-plugged:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:48:46 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] Creating event network-vif-plugged:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:48:46 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034235 Apr 14 10:48:46 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 128/387] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:48:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:48:49 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-b4fe009f-94e4-48d0-98c6-22232469cb69 req-3deab8c7-a8ae-4ce4-ac89-343fb4fb1e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "name": "network-vif-plugged", "status": "completed", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:48:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-b4fe009f-94e4-48d0-98c6-22232469cb69 req-3deab8c7-a8ae-4ce4-ac89-343fb4fb1e4c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:48:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-b4fe009f-94e4-48d0-98c6-22232469cb69 req-3deab8c7-a8ae-4ce4-ac89-343fb4fb1e4c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:48:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-b4fe009f-94e4-48d0-98c6-22232469cb69 req-3deab8c7-a8ae-4ce4-ac89-343fb4fb1e4c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:48:49 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-b4fe009f-94e4-48d0-98c6-22232469cb69 req-3deab8c7-a8ae-4ce4-ac89-343fb4fb1e4c service nova] Creating event network-vif-plugged:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:48:49 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-b4fe009f-94e4-48d0-98c6-22232469cb69 req-3deab8c7-a8ae-4ce4-ac89-343fb4fb1e4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035674 Apr 14 10:48:49 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 134/388] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:48:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:02 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:49:02 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=12 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:49:02 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-ef04142f-edee-4b02-b5c2-30c4b0e164e5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:02 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-ef04142f-edee-4b02-b5c2-30c4b0e164e5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ef04142f-edee-4b02-b5c2-30c4b0e164e5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ef04142f-edee-4b02-b5c2-30c4b0e164e5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ef04142f-edee-4b02-b5c2-30c4b0e164e5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ef04142f-edee-4b02-b5c2-30c4b0e164e5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ef04142f-edee-4b02-b5c2-30c4b0e164e5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ef04142f-edee-4b02-b5c2-30c4b0e164e5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:02 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-ef04142f-edee-4b02-b5c2-30c4b0e164e5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6adefa90332c42c79a1372258a7be5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca26975e5ad4524b4b1b1ec4335802f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:49:02 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-ef04142f-edee-4b02-b5c2-30c4b0e164e5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9" status: 200 len: 1543 microversion: 2.1 time: 0.185900 Apr 14 10:49:02 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 127/389] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:49:02 2023] GET /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9 => generated 1543 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:49:15 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d94877ef-604b-4237-9230-b1160df82317 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:15 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-d94877ef-604b-4237-9230-b1160df82317 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:15 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:49:15 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:49:15 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d94877ef-604b-4237-9230-b1160df82317 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:15 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d94877ef-604b-4237-9230-b1160df82317 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:15 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d94877ef-604b-4237-9230-b1160df82317 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:15 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d94877ef-604b-4237-9230-b1160df82317 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:15 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d94877ef-604b-4237-9230-b1160df82317 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:15 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d94877ef-604b-4237-9230-b1160df82317 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:15 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d94877ef-604b-4237-9230-b1160df82317 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.098365 Apr 14 10:49:15 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 129/390] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 10:49:15 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/os-interface => generated 282 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:15 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=8 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:49:15 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=16 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:49:15 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-f52973f9-990c-4f6a-bd46-9c5d57e91ad7 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:15 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-f52973f9-990c-4f6a-bd46-9c5d57e91ad7 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f52973f9-990c-4f6a-bd46-9c5d57e91ad7 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f52973f9-990c-4f6a-bd46-9c5d57e91ad7 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f52973f9-990c-4f6a-bd46-9c5d57e91ad7 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f52973f9-990c-4f6a-bd46-9c5d57e91ad7 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f52973f9-990c-4f6a-bd46-9c5d57e91ad7 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f52973f9-990c-4f6a-bd46-9c5d57e91ad7 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:15 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-f52973f9-990c-4f6a-bd46-9c5d57e91ad7 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.200315 Apr 14 10:49:15 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 135/391] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:49:15 2023] GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments => generated 25 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG nova.objects.instance [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lazy-loading 'services' on Instance uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=61839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:49:16 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-8948854c-63af-4abe-8d84-4bb46ebfc21e req-98dfa048-a948-47df-a5cc-74b9546b73b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8586a70e-9855-4177-ac1b-cf707a4df871", "tag": "473d9af8-25a0-4e5a-9afb-7a0c843115cc"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8948854c-63af-4abe-8d84-4bb46ebfc21e req-98dfa048-a948-47df-a5cc-74b9546b73b5 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8948854c-63af-4abe-8d84-4bb46ebfc21e req-98dfa048-a948-47df-a5cc-74b9546b73b5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8948854c-63af-4abe-8d84-4bb46ebfc21e req-98dfa048-a948-47df-a5cc-74b9546b73b5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-8948854c-63af-4abe-8d84-4bb46ebfc21e req-98dfa048-a948-47df-a5cc-74b9546b73b5 service nova] Creating event network-changed:473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance 8586a70e-9855-4177-ac1b-cf707a4df871 on user Apr 14 10:49:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-8948854c-63af-4abe-8d84-4bb46ebfc21e req-98dfa048-a948-47df-a5cc-74b9546b73b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035436 Apr 14 10:49:16 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 130/392] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:49:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:16 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-2642ec9b-e5dc-44ac-9275-6dfde32b2f77 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:16 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-2642ec9b-e5dc-44ac-9275-6dfde32b2f77 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2642ec9b-e5dc-44ac-9275-6dfde32b2f77 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2642ec9b-e5dc-44ac-9275-6dfde32b2f77 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2642ec9b-e5dc-44ac-9275-6dfde32b2f77 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2642ec9b-e5dc-44ac-9275-6dfde32b2f77 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2642ec9b-e5dc-44ac-9275-6dfde32b2f77 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2642ec9b-e5dc-44ac-9275-6dfde32b2f77 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:16 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/os-volume_attachments/4116efc6-988f-40cf-af06-2abf9c6cd44a" status: 202 len: 0 microversion: 2.1 time: 0.227318 Apr 14 10:49:16 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 128/393] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:49:16 2023] DELETE /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/os-volume_attachments/4116efc6-988f-40cf-af06-2abf9c6cd44a => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:49:16 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-9c7ecc88-d4a7-4ee5-86e3-779a53a0547f tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:16 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-2642ec9b-e5dc-44ac-9275-6dfde32b2f77 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/ips" status: 200 len: 103 microversion: 2.1 time: 0.037102 Apr 14 10:49:16 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 136/394] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 10:49:16 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/ips => generated 103 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:16 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-9c7ecc88-d4a7-4ee5-86e3-779a53a0547f tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-9c7ecc88-d4a7-4ee5-86e3-779a53a0547f tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-9c7ecc88-d4a7-4ee5-86e3-779a53a0547f tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-9c7ecc88-d4a7-4ee5-86e3-779a53a0547f tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-9c7ecc88-d4a7-4ee5-86e3-779a53a0547f tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-9c7ecc88-d4a7-4ee5-86e3-779a53a0547f tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-9c7ecc88-d4a7-4ee5-86e3-779a53a0547f tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-9c7ecc88-d4a7-4ee5-86e3-779a53a0547f tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049901 Apr 14 10:49:16 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 131/395] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:49:16 2023] GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-43d2150e-cdb7-4f0a-94c8-1a1b6ca91909 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-43d2150e-cdb7-4f0a-94c8-1a1b6ca91909 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-43d2150e-cdb7-4f0a-94c8-1a1b6ca91909 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-43d2150e-cdb7-4f0a-94c8-1a1b6ca91909 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-43d2150e-cdb7-4f0a-94c8-1a1b6ca91909 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-43d2150e-cdb7-4f0a-94c8-1a1b6ca91909 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-43d2150e-cdb7-4f0a-94c8-1a1b6ca91909 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-43d2150e-cdb7-4f0a-94c8-1a1b6ca91909 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-43d2150e-cdb7-4f0a-94c8-1a1b6ca91909 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-43d2150e-cdb7-4f0a-94c8-1a1b6ca91909 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:49:16 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-43d2150e-cdb7-4f0a-94c8-1a1b6ca91909 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:49:16 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-43d2150e-cdb7-4f0a-94c8-1a1b6ca91909 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07" status: 200 len: 1690 microversion: 2.87 time: 0.173419 Apr 14 10:49:16 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 129/396] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:49:16 2023] GET /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:49:18 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-4c6f5e62-3a6b-4a40-ac99-ab6c3b022b7f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45bc910b-b6b1-40a2-bb21-82532f59871d"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:18 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-4c6f5e62-3a6b-4a40-ac99-ab6c3b022b7f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4c6f5e62-3a6b-4a40-ac99-ab6c3b022b7f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4c6f5e62-3a6b-4a40-ac99-ab6c3b022b7f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4c6f5e62-3a6b-4a40-ac99-ab6c3b022b7f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4c6f5e62-3a6b-4a40-ac99-ab6c3b022b7f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4c6f5e62-3a6b-4a40-ac99-ab6c3b022b7f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4c6f5e62-3a6b-4a40-ac99-ab6c3b022b7f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:18 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-4c6f5e62-3a6b-4a40-ac99-ab6c3b022b7f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 97f20661-8b60-439e-b7af-2fc2013c5ade while it is in vm_state rescued Apr 14 10:49:18 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-4c6f5e62-3a6b-4a40-ac99-ab6c3b022b7f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Request method failure captured: Apr 14 10:49:18 user devstack@n-api.service[61841]: request: POST /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade/os-volume_attachments HTTP/1.1 Apr 14 10:49:18 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:49:18 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:49:18 user devstack@n-api.service[61841]: Connection: close Apr 14 10:49:18 user devstack@n-api.service[61841]: Content-Length: 74 Apr 14 10:49:18 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:49:18 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:49:18 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:49:18 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:49:18 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4ehvfPZmc6Cn8y_nUIgKmNt1MynNk1Jx9BkLUufz1O66F8ryB_RqLkjS4mqbIJCUIPkzgHXdvu3Dcwu4qkkSxSHHlhjBDdWlDUtyfTJIWQwoe_fVC9Grh5B2CbrOSLWshhTkM317x0-K8crYQxMYn74sVjwEj0iqM8tWzpqn1eQII Apr 14 10:49:18 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:49:18 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:49:18 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:49:18 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:49:18 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:49:18 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:49:18 user devstack@n-api.service[61841]: X-Project-Id: bf93e5dac50342d0b65ef09711401e99 Apr 14 10:49:18 user devstack@n-api.service[61841]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-563868574 Apr 14 10:49:18 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:49:18 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:49:18 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf93e5dac50342d0b65ef09711401e99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf93e5dac50342d0b65ef09711401e99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf93e5dac50342d0b65ef09711401e99"}]}] Apr 14 10:49:18 user devstack@n-api.service[61841]: X-Tenant: tempest-ServerRescueNegativeTestJSON-563868574 Apr 14 10:49:18 user devstack@n-api.service[61841]: X-Tenant-Id: bf93e5dac50342d0b65ef09711401e99 Apr 14 10:49:18 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-563868574 Apr 14 10:49:18 user devstack@n-api.service[61841]: X-User: tempest-ServerRescueNegativeTestJSON-563868574-project-member Apr 14 10:49:18 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:49:18 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:49:18 user devstack@n-api.service[61841]: X-User-Id: e359578dcbb24755a216415053d415ef Apr 14 10:49:18 user devstack@n-api.service[61841]: X-User-Name: tempest-ServerRescueNegativeTestJSON-563868574-project-member Apr 14 10:49:18 user devstack@n-api.service[61841]: Apr 14 10:49:18 user devstack@n-api.service[61841]: {"volumeAttachment": {"volumeId": "45bc910b-b6b1-40a2-bb21-82532f59871d"}} Apr 14 10:49:18 user devstack@n-api.service[61841]: method: > Apr 14 10:49:18 user devstack@n-api.service[61841]: exception: Cannot 'attach_volume' instance 97f20661-8b60-439e-b7af-2fc2013c5ade while it is in vm_state rescued Apr 14 10:49:18 user devstack@n-api.service[61841]: action_args: {'server_id': '97f20661-8b60-439e-b7af-2fc2013c5ade', 'body': {'volumeAttachment': {'volumeId': '45bc910b-b6b1-40a2-bb21-82532f59871d'}}} Apr 14 10:49:18 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97f20661-8b60-439e-b7af-2fc2013c5ade in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 97f20661-8b60-439e-b7af-2fc2013c5ade while it is in vm_state rescued Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 97f20661-8b60-439e-b7af-2fc2013c5ade while it is in vm_state rescued Apr 14 10:49:18 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:49:18 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-4c6f5e62-3a6b-4a40-ac99-ab6c3b022b7f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Returning 409 to user: Cannot 'attach_volume' instance 97f20661-8b60-439e-b7af-2fc2013c5ade while it is in vm_state rescued {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:49:18 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-4c6f5e62-3a6b-4a40-ac99-ab6c3b022b7f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "POST /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043632 Apr 14 10:49:18 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 137/397] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:49:18 2023] POST /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 10:49:18 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:18 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "POST /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade/action" status: 202 len: 0 microversion: 2.1 time: 0.075628 Apr 14 10:49:18 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 132/398] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:49:18 2023] POST /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:49:18 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-b04d90b6-1dfd-4e9d-a279-cc5851090d9a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:18 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-b04d90b6-1dfd-4e9d-a279-cc5851090d9a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b04d90b6-1dfd-4e9d-a279-cc5851090d9a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b04d90b6-1dfd-4e9d-a279-cc5851090d9a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b04d90b6-1dfd-4e9d-a279-cc5851090d9a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b04d90b6-1dfd-4e9d-a279-cc5851090d9a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b04d90b6-1dfd-4e9d-a279-cc5851090d9a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b04d90b6-1dfd-4e9d-a279-cc5851090d9a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:18 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-b04d90b6-1dfd-4e9d-a279-cc5851090d9a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:49:18 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-b04d90b6-1dfd-4e9d-a279-cc5851090d9a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade" status: 200 len: 1497 microversion: 2.1 time: 0.263465 Apr 14 10:49:18 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 130/399] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:49:18 2023] GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade => generated 1497 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:49:19 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64fbf5f9-3b53-42b6-8eb9-34688db256a2"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:19 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:19 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321499 Apr 14 10:49:19 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 138/400] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:49:19 2023] POST /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:19 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-4554a73c-15e6-4a64-a750-96c9d25b630d req-500ef23d-b2bc-4ef6-9d22-38b1b60acfd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-unplugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-4554a73c-15e6-4a64-a750-96c9d25b630d req-500ef23d-b2bc-4ef6-9d22-38b1b60acfd2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-4554a73c-15e6-4a64-a750-96c9d25b630d req-500ef23d-b2bc-4ef6-9d22-38b1b60acfd2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-4554a73c-15e6-4a64-a750-96c9d25b630d req-500ef23d-b2bc-4ef6-9d22-38b1b60acfd2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:19 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-4554a73c-15e6-4a64-a750-96c9d25b630d req-500ef23d-b2bc-4ef6-9d22-38b1b60acfd2 service nova] Creating event network-vif-unplugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:49:19 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-4554a73c-15e6-4a64-a750-96c9d25b630d req-500ef23d-b2bc-4ef6-9d22-38b1b60acfd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035388 Apr 14 10:49:19 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 133/401] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:49:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:20 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98928234-b030-42db-89fd-9b21352606dc"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:20 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:20 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "POST /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351791 Apr 14 10:49:20 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 131/402] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:49:20 2023] POST /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments => generated 194 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-9a734b39-b307-4d1d-9eaa-2a43c4b47164 req-d0a56118-fc4c-4a5d-bc0d-d7f2d39ffadc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39586d44-1d8e-4607-ab4d-c03a7d841606", "tag": "6099437e-5607-4a06-abcb-15d465c7ecf8"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:21 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-9a734b39-b307-4d1d-9eaa-2a43c4b47164 req-d0a56118-fc4c-4a5d-bc0d-d7f2d39ffadc service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-9a734b39-b307-4d1d-9eaa-2a43c4b47164 req-d0a56118-fc4c-4a5d-bc0d-d7f2d39ffadc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-9a734b39-b307-4d1d-9eaa-2a43c4b47164 req-d0a56118-fc4c-4a5d-bc0d-d7f2d39ffadc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:21 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-9a734b39-b307-4d1d-9eaa-2a43c4b47164 req-d0a56118-fc4c-4a5d-bc0d-d7f2d39ffadc service nova] Creating event network-changed:6099437e-5607-4a06-abcb-15d465c7ecf8 for instance 39586d44-1d8e-4607-ab4d-c03a7d841606 on user Apr 14 10:49:21 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-9a734b39-b307-4d1d-9eaa-2a43c4b47164 req-d0a56118-fc4c-4a5d-bc0d-d7f2d39ffadc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051711 Apr 14 10:49:21 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 134/403] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:49:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:21 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:49:21 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606" status: 204 len: 0 microversion: 2.1 time: 0.196045 Apr 14 10:49:21 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 139/404] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:49:21 2023] DELETE /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:49:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-4b60bc9e-dfd0-4609-afca-621b4727423a tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:21 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-4b60bc9e-dfd0-4609-afca-621b4727423a tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4b60bc9e-dfd0-4609-afca-621b4727423a tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4b60bc9e-dfd0-4609-afca-621b4727423a tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4b60bc9e-dfd0-4609-afca-621b4727423a tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4b60bc9e-dfd0-4609-afca-621b4727423a tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4b60bc9e-dfd0-4609-afca-621b4727423a tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4b60bc9e-dfd0-4609-afca-621b4727423a tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-be3e3f4b-03d5-447c-89da-40d70c9f4842 req-93350680-b1d5-4a74-8ae1-d999559b7422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-plugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-be3e3f4b-03d5-447c-89da-40d70c9f4842 req-93350680-b1d5-4a74-8ae1-d999559b7422 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-be3e3f4b-03d5-447c-89da-40d70c9f4842 req-93350680-b1d5-4a74-8ae1-d999559b7422 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-be3e3f4b-03d5-447c-89da-40d70c9f4842 req-93350680-b1d5-4a74-8ae1-d999559b7422 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:21 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-be3e3f4b-03d5-447c-89da-40d70c9f4842 req-93350680-b1d5-4a74-8ae1-d999559b7422 service nova] Creating event network-vif-plugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:49:21 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-be3e3f4b-03d5-447c-89da-40d70c9f4842 req-93350680-b1d5-4a74-8ae1-d999559b7422 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031621 Apr 14 10:49:21 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 135/405] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:49:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:21 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-4b60bc9e-dfd0-4609-afca-621b4727423a tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15c4ab86a8d244c4be5889b4ac47561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e1e1695464eb5ad8a8c881cf24611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:49:21 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-4b60bc9e-dfd0-4609-afca-621b4727423a tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606" status: 200 len: 1557 microversion: 2.1 time: 0.190799 Apr 14 10:49:21 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 132/406] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:49:21 2023] GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606 => generated 1557 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:49:23 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-plugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}, {"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-plugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}, {"server_uuid": "39586d44-1d8e-4607-ab4d-c03a7d841606", "name": "network-vif-unplugged", "status": "completed", "tag": "6099437e-5607-4a06-abcb-15d465c7ecf8"}, {"server_uuid": "39586d44-1d8e-4607-ab4d-c03a7d841606", "name": "network-vif-plugged", "status": "completed", "tag": "6099437e-5607-4a06-abcb-15d465c7ecf8"}, {"server_uuid": "39586d44-1d8e-4607-ab4d-c03a7d841606", "name": "network-vif-deleted", "tag": "6099437e-5607-4a06-abcb-15d465c7ecf8"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:23 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Creating event network-vif-plugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:49:23 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Creating event network-vif-plugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:49:23 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Creating event network-vif-unplugged:6099437e-5607-4a06-abcb-15d465c7ecf8 for instance 39586d44-1d8e-4607-ab4d-c03a7d841606 on user Apr 14 10:49:23 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Creating event network-vif-plugged:6099437e-5607-4a06-abcb-15d465c7ecf8 for instance 39586d44-1d8e-4607-ab4d-c03a7d841606 on user Apr 14 10:49:23 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Creating event network-vif-deleted:6099437e-5607-4a06-abcb-15d465c7ecf8 for instance 39586d44-1d8e-4607-ab4d-c03a7d841606 on user Apr 14 10:49:23 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.037595 Apr 14 10:49:23 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 140/407] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:49:23 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:29 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec6269ad-4a21-4afb-b769-a969d5e3c92f", "device": "/dev/vdb"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:29 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "POST /compute/v2.1/servers/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351123 Apr 14 10:49:29 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 136/408] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:49:29 2023] POST /compute/v2.1/servers/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:29 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-bfde89d5-f629-4b7c-b77a-49c3e8bbd3df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bfde89d5-f629-4b7c-b77a-49c3e8bbd3df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bfde89d5-f629-4b7c-b77a-49c3e8bbd3df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bfde89d5-f629-4b7c-b77a-49c3e8bbd3df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:29 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-bfde89d5-f629-4b7c-b77a-49c3e8bbd3df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Going to try to stop instance {{(pid=61839) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 10:49:29 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-bfde89d5-f629-4b7c-b77a-49c3e8bbd3df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/action" status: 202 len: 0 microversion: 2.1 time: 0.109533 Apr 14 10:49:29 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 133/409] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:49:29 2023] POST /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:49:29 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-ebc29a05-5050-42f1-896d-cdba5962f0b2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:29 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-ebc29a05-5050-42f1-896d-cdba5962f0b2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ebc29a05-5050-42f1-896d-cdba5962f0b2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ebc29a05-5050-42f1-896d-cdba5962f0b2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ebc29a05-5050-42f1-896d-cdba5962f0b2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ebc29a05-5050-42f1-896d-cdba5962f0b2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ebc29a05-5050-42f1-896d-cdba5962f0b2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ebc29a05-5050-42f1-896d-cdba5962f0b2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:30 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-ebc29a05-5050-42f1-896d-cdba5962f0b2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:49:30 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-ebc29a05-5050-42f1-896d-cdba5962f0b2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871" status: 200 len: 1710 microversion: 2.1 time: 0.247233 Apr 14 10:49:30 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 141/410] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:49:29 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 => generated 1710 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:49:30 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-54af982e-30de-45e6-a4c7-4931823e0a3c req-a6c0147d-9ac9-47c0-8091-71414d8df011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8586a70e-9855-4177-ac1b-cf707a4df871", "name": "network-vif-unplugged", "status": "completed", "tag": "473d9af8-25a0-4e5a-9afb-7a0c843115cc"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-54af982e-30de-45e6-a4c7-4931823e0a3c req-a6c0147d-9ac9-47c0-8091-71414d8df011 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-54af982e-30de-45e6-a4c7-4931823e0a3c req-a6c0147d-9ac9-47c0-8091-71414d8df011 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-54af982e-30de-45e6-a4c7-4931823e0a3c req-a6c0147d-9ac9-47c0-8091-71414d8df011 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:30 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-54af982e-30de-45e6-a4c7-4931823e0a3c req-a6c0147d-9ac9-47c0-8091-71414d8df011 service nova] Creating event network-vif-unplugged:473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance 8586a70e-9855-4177-ac1b-cf707a4df871 on user Apr 14 10:49:30 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-54af982e-30de-45e6-a4c7-4931823e0a3c req-a6c0147d-9ac9-47c0-8091-71414d8df011 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032727 Apr 14 10:49:30 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 137/411] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:49:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:32 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-4358c04e-0be5-4753-870c-2c78cbb30f18 req-b0fa3df2-07ba-433f-b40d-d08d297a68a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8586a70e-9855-4177-ac1b-cf707a4df871", "name": "network-vif-plugged", "status": "completed", "tag": "473d9af8-25a0-4e5a-9afb-7a0c843115cc"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:32 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4358c04e-0be5-4753-870c-2c78cbb30f18 req-b0fa3df2-07ba-433f-b40d-d08d297a68a9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4358c04e-0be5-4753-870c-2c78cbb30f18 req-b0fa3df2-07ba-433f-b40d-d08d297a68a9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4358c04e-0be5-4753-870c-2c78cbb30f18 req-b0fa3df2-07ba-433f-b40d-d08d297a68a9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:32 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-4358c04e-0be5-4753-870c-2c78cbb30f18 req-b0fa3df2-07ba-433f-b40d-d08d297a68a9 service nova] Creating event network-vif-plugged:473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance 8586a70e-9855-4177-ac1b-cf707a4df871 on user Apr 14 10:49:32 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-4358c04e-0be5-4753-870c-2c78cbb30f18 req-b0fa3df2-07ba-433f-b40d-d08d297a68a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044891 Apr 14 10:49:32 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 134/412] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:49:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:32 user devstack@n-api.service[61841]: DEBUG nova.objects.instance [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'services' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=61841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:49:32 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments/98928234-b030-42db-89fd-9b21352606dc" status: 202 len: 0 microversion: 2.1 time: 0.180312 Apr 14 10:49:32 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 142/413] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:49:32 2023] DELETE /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments/98928234-b030-42db-89fd-9b21352606dc => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:49:32 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-a3baa945-343f-41b0-9dea-fed8263e49fd tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:32 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-a3baa945-343f-41b0-9dea-fed8263e49fd tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a3baa945-343f-41b0-9dea-fed8263e49fd tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a3baa945-343f-41b0-9dea-fed8263e49fd tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a3baa945-343f-41b0-9dea-fed8263e49fd tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a3baa945-343f-41b0-9dea-fed8263e49fd tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a3baa945-343f-41b0-9dea-fed8263e49fd tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a3baa945-343f-41b0-9dea-fed8263e49fd tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-a3baa945-343f-41b0-9dea-fed8263e49fd tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051091 Apr 14 10:49:32 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 138/414] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:49:32 2023] GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:39 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:39 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:39 user devstack@n-api.service[61839]: DEBUG nova.objects.instance [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'services' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=61839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:49:39 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/os-volume_attachments/2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d" status: 202 len: 0 microversion: 2.1 time: 0.172417 Apr 14 10:49:39 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 135/415] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:49:39 2023] DELETE /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/os-volume_attachments/2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:49:39 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-7cdcbf2d-b03b-473a-a613-810d3dcf0ad2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:39 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-7cdcbf2d-b03b-473a-a613-810d3dcf0ad2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7cdcbf2d-b03b-473a-a613-810d3dcf0ad2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7cdcbf2d-b03b-473a-a613-810d3dcf0ad2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7cdcbf2d-b03b-473a-a613-810d3dcf0ad2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7cdcbf2d-b03b-473a-a613-810d3dcf0ad2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7cdcbf2d-b03b-473a-a613-810d3dcf0ad2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7cdcbf2d-b03b-473a-a613-810d3dcf0ad2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:39 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-7cdcbf2d-b03b-473a-a613-810d3dcf0ad2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 Apr 14 10:49:39 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 143/416] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:49:39 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:43 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-b33571a2-45f7-4326-8d65-e97f30d8b956 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6828770-fda7-4cd5-b857-c4d2599299a7"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:43 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-b33571a2-45f7-4326-8d65-e97f30d8b956 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:43 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=20 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:49:43 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:49:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b33571a2-45f7-4326-8d65-e97f30d8b956 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b33571a2-45f7-4326-8d65-e97f30d8b956 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b33571a2-45f7-4326-8d65-e97f30d8b956 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b33571a2-45f7-4326-8d65-e97f30d8b956 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b33571a2-45f7-4326-8d65-e97f30d8b956 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b33571a2-45f7-4326-8d65-e97f30d8b956 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:43 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-b33571a2-45f7-4326-8d65-e97f30d8b956 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300620 Apr 14 10:49:43 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 139/417] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 10:49:43 2023] POST /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:49:43 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:43 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:43 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61839) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 10:49:43 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/action" status: 202 len: 0 microversion: 2.20 time: 0.108369 Apr 14 10:49:43 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 136/418] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 10:49:43 2023] POST /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:49:43 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-73e83162-1b3f-427f-b5e7-5b500fa28196 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:43 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-73e83162-1b3f-427f-b5e7-5b500fa28196 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-73e83162-1b3f-427f-b5e7-5b500fa28196 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-73e83162-1b3f-427f-b5e7-5b500fa28196 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-73e83162-1b3f-427f-b5e7-5b500fa28196 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-73e83162-1b3f-427f-b5e7-5b500fa28196 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-73e83162-1b3f-427f-b5e7-5b500fa28196 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-73e83162-1b3f-427f-b5e7-5b500fa28196 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:43 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-73e83162-1b3f-427f-b5e7-5b500fa28196 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:49:43 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-73e83162-1b3f-427f-b5e7-5b500fa28196 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:49:43 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-73e83162-1b3f-427f-b5e7-5b500fa28196 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:49:43 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-73e83162-1b3f-427f-b5e7-5b500fa28196 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae" status: 200 len: 1739 microversion: 2.20 time: 0.161853 Apr 14 10:49:43 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 144/419] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:49:43 2023] GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:49:50 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-ccf87390-2abd-4ce2-ad44-c72c2ab1be13 req-7677bfe0-9073-481d-be61-3219f61e472c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b767f1b-e97e-497c-8c70-8806203c76ae", "tag": "8d8a356d-c198-4e13-a489-5c626fbd025c"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ccf87390-2abd-4ce2-ad44-c72c2ab1be13 req-7677bfe0-9073-481d-be61-3219f61e472c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ccf87390-2abd-4ce2-ad44-c72c2ab1be13 req-7677bfe0-9073-481d-be61-3219f61e472c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ccf87390-2abd-4ce2-ad44-c72c2ab1be13 req-7677bfe0-9073-481d-be61-3219f61e472c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:51 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-ccf87390-2abd-4ce2-ad44-c72c2ab1be13 req-7677bfe0-9073-481d-be61-3219f61e472c service nova] Creating event network-changed:8d8a356d-c198-4e13-a489-5c626fbd025c for instance 4b767f1b-e97e-497c-8c70-8806203c76ae on user Apr 14 10:49:51 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-ccf87390-2abd-4ce2-ad44-c72c2ab1be13 req-7677bfe0-9073-481d-be61-3219f61e472c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038502 Apr 14 10:49:51 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 140/420] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:49:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:56 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:49:56 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=5,nova_cell1:UPDATE=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:49:56 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:56 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:57 user devstack@n-api.service[61839]: DEBUG nova.objects.instance [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lazy-loading 'services' on Instance uuid 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 {{(pid=61839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:49:57 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/os-volume_attachments/ec6269ad-4a21-4afb-b769-a969d5e3c92f" status: 202 len: 0 microversion: 2.1 time: 0.179738 Apr 14 10:49:57 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 137/421] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:49:56 2023] DELETE /compute/v2.1/servers/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/os-volume_attachments/ec6269ad-4a21-4afb-b769-a969d5e3c92f => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:49:57 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:57 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:57 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:49:57 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:49:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:57 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:49:57 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" status: 204 len: 0 microversion: 2.1 time: 0.132114 Apr 14 10:49:57 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 145/422] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:49:57 2023] DELETE /compute/v2.1/servers/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:49:57 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-009f9290-4d36-446a-96a8-d1e45425a06b tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:49:57 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-009f9290-4d36-446a-96a8-d1e45425a06b tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:49:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-009f9290-4d36-446a-96a8-d1e45425a06b tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-009f9290-4d36-446a-96a8-d1e45425a06b tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-009f9290-4d36-446a-96a8-d1e45425a06b tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-009f9290-4d36-446a-96a8-d1e45425a06b tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-009f9290-4d36-446a-96a8-d1e45425a06b tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-009f9290-4d36-446a-96a8-d1e45425a06b tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:57 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-009f9290-4d36-446a-96a8-d1e45425a06b tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac498c56dae543cf9e64fbb61ad50df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84a2fac4604454982dc018b36440b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:49:57 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-009f9290-4d36-446a-96a8-d1e45425a06b tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" status: 200 len: 1548 microversion: 2.1 time: 0.148036 Apr 14 10:49:57 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 141/423] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:49:57 2023] GET /compute/v2.1/servers/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:49:59 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-f1d96268-7f98-4eae-b2c7-c1c1d794a30a req-071cd083-f4f3-44d8-8364-debb1b622005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b767f1b-e97e-497c-8c70-8806203c76ae", "name": "network-vif-plugged", "status": "completed", "tag": "8d8a356d-c198-4e13-a489-5c626fbd025c"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f1d96268-7f98-4eae-b2c7-c1c1d794a30a req-071cd083-f4f3-44d8-8364-debb1b622005 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f1d96268-7f98-4eae-b2c7-c1c1d794a30a req-071cd083-f4f3-44d8-8364-debb1b622005 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f1d96268-7f98-4eae-b2c7-c1c1d794a30a req-071cd083-f4f3-44d8-8364-debb1b622005 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-f1d96268-7f98-4eae-b2c7-c1c1d794a30a req-071cd083-f4f3-44d8-8364-debb1b622005 service nova] Creating event network-vif-plugged:8d8a356d-c198-4e13-a489-5c626fbd025c for instance 4b767f1b-e97e-497c-8c70-8806203c76ae on user Apr 14 10:49:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-f1d96268-7f98-4eae-b2c7-c1c1d794a30a req-071cd083-f4f3-44d8-8364-debb1b622005 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067241 Apr 14 10:49:59 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 138/424] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:49:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:49:59 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-9fb92039-e123-4ac7-8f99-3eafe49a89a7 req-47b4fe2d-f494-4bbc-9f9c-5bfa7a3dff5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108", "name": "network-vif-unplugged", "status": "completed", "tag": "01a9c136-4a03-464b-bc37-e95ab62f6f1a"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:49:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-9fb92039-e123-4ac7-8f99-3eafe49a89a7 req-47b4fe2d-f494-4bbc-9f9c-5bfa7a3dff5a service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:49:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-9fb92039-e123-4ac7-8f99-3eafe49a89a7 req-47b4fe2d-f494-4bbc-9f9c-5bfa7a3dff5a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:49:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-9fb92039-e123-4ac7-8f99-3eafe49a89a7 req-47b4fe2d-f494-4bbc-9f9c-5bfa7a3dff5a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:49:59 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-9fb92039-e123-4ac7-8f99-3eafe49a89a7 req-47b4fe2d-f494-4bbc-9f9c-5bfa7a3dff5a service nova] Creating event network-vif-unplugged:01a9c136-4a03-464b-bc37-e95ab62f6f1a for instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 on user Apr 14 10:49:59 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-9fb92039-e123-4ac7-8f99-3eafe49a89a7 req-47b4fe2d-f494-4bbc-9f9c-5bfa7a3dff5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037865 Apr 14 10:49:59 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 146/425] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:49:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:50:00 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-63f08869-db84-407f-81fe-cdeae3fbd2c3 req-8b01a20f-f377-49fe-9cfd-0d9d2957f41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108", "name": "network-vif-deleted", "tag": "01a9c136-4a03-464b-bc37-e95ab62f6f1a"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-63f08869-db84-407f-81fe-cdeae3fbd2c3 req-8b01a20f-f377-49fe-9cfd-0d9d2957f41d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-63f08869-db84-407f-81fe-cdeae3fbd2c3 req-8b01a20f-f377-49fe-9cfd-0d9d2957f41d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-63f08869-db84-407f-81fe-cdeae3fbd2c3 req-8b01a20f-f377-49fe-9cfd-0d9d2957f41d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:00 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-63f08869-db84-407f-81fe-cdeae3fbd2c3 req-8b01a20f-f377-49fe-9cfd-0d9d2957f41d service nova] Creating event network-vif-deleted:01a9c136-4a03-464b-bc37-e95ab62f6f1a for instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 on user Apr 14 10:50:00 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-63f08869-db84-407f-81fe-cdeae3fbd2c3 req-8b01a20f-f377-49fe-9cfd-0d9d2957f41d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032010 Apr 14 10:50:00 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 142/426] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:50:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:50:01 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-04bb5fe3-2315-447c-b91f-27ad1c1bc42f req-a66e377a-6cdd-437a-8208-e7b137dc41a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b767f1b-e97e-497c-8c70-8806203c76ae", "name": "network-vif-plugged", "status": "completed", "tag": "8d8a356d-c198-4e13-a489-5c626fbd025c"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:01 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-04bb5fe3-2315-447c-b91f-27ad1c1bc42f req-a66e377a-6cdd-437a-8208-e7b137dc41a9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:01 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-04bb5fe3-2315-447c-b91f-27ad1c1bc42f req-a66e377a-6cdd-437a-8208-e7b137dc41a9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:01 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-04bb5fe3-2315-447c-b91f-27ad1c1bc42f req-a66e377a-6cdd-437a-8208-e7b137dc41a9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:01 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-04bb5fe3-2315-447c-b91f-27ad1c1bc42f req-a66e377a-6cdd-437a-8208-e7b137dc41a9 service nova] Creating event network-vif-plugged:8d8a356d-c198-4e13-a489-5c626fbd025c for instance 4b767f1b-e97e-497c-8c70-8806203c76ae on user Apr 14 10:50:01 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-04bb5fe3-2315-447c-b91f-27ad1c1bc42f req-a66e377a-6cdd-437a-8208-e7b137dc41a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038879 Apr 14 10:50:01 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 139/427] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:50:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:50:01 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-af96be9f-8d76-48d5-b201-34f868e78bdc req-110cbb01-98ec-4b98-9538-d64925c5ebfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108", "name": "network-vif-plugged", "status": "completed", "tag": "01a9c136-4a03-464b-bc37-e95ab62f6f1a"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-af96be9f-8d76-48d5-b201-34f868e78bdc req-110cbb01-98ec-4b98-9538-d64925c5ebfc service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-af96be9f-8d76-48d5-b201-34f868e78bdc req-110cbb01-98ec-4b98-9538-d64925c5ebfc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-af96be9f-8d76-48d5-b201-34f868e78bdc req-110cbb01-98ec-4b98-9538-d64925c5ebfc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:01 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-af96be9f-8d76-48d5-b201-34f868e78bdc req-110cbb01-98ec-4b98-9538-d64925c5ebfc service nova] Creating event network-vif-plugged:01a9c136-4a03-464b-bc37-e95ab62f6f1a for instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 on user Apr 14 10:50:01 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-af96be9f-8d76-48d5-b201-34f868e78bdc req-110cbb01-98ec-4b98-9538-d64925c5ebfc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030468 Apr 14 10:50:01 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 147/428] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:50:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:50:02 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-eb7e8924-b1f2-4f65-a633-92bc7393859b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:02 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-eb7e8924-b1f2-4f65-a633-92bc7393859b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-eb7e8924-b1f2-4f65-a633-92bc7393859b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-eb7e8924-b1f2-4f65-a633-92bc7393859b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-eb7e8924-b1f2-4f65-a633-92bc7393859b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-eb7e8924-b1f2-4f65-a633-92bc7393859b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-eb7e8924-b1f2-4f65-a633-92bc7393859b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-eb7e8924-b1f2-4f65-a633-92bc7393859b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:02 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-eb7e8924-b1f2-4f65-a633-92bc7393859b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.091624 Apr 14 10:50:02 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 143/429] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 10:50:02 2023] GET /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/os-interface => generated 283 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:50:03 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-4e6d127b-aa69-4a29-adec-375628fd527a req-333cd5b6-fdbb-47d0-bc8f-497d2130774d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3245b74-dbe8-4b8b-83b6-58a4811fdba9", "tag": "9abeb28a-35f1-4e16-a152-ed2578e8a678"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4e6d127b-aa69-4a29-adec-375628fd527a req-333cd5b6-fdbb-47d0-bc8f-497d2130774d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4e6d127b-aa69-4a29-adec-375628fd527a req-333cd5b6-fdbb-47d0-bc8f-497d2130774d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4e6d127b-aa69-4a29-adec-375628fd527a req-333cd5b6-fdbb-47d0-bc8f-497d2130774d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:03 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-4e6d127b-aa69-4a29-adec-375628fd527a req-333cd5b6-fdbb-47d0-bc8f-497d2130774d service nova] Creating event network-changed:9abeb28a-35f1-4e16-a152-ed2578e8a678 for instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 on user Apr 14 10:50:03 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-4e6d127b-aa69-4a29-adec-375628fd527a req-333cd5b6-fdbb-47d0-bc8f-497d2130774d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044777 Apr 14 10:50:03 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 140/430] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:50:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:50:05 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d9a98d6-ea02-4e9e-8af7-d744d734e3e9"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:05 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:06 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276906 Apr 14 10:50:06 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 148/431] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:50:05 2023] POST /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:50:06 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ef7a5426-c117-40f2-972d-8f5f2617227e tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:06 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-ef7a5426-c117-40f2-972d-8f5f2617227e tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ef7a5426-c117-40f2-972d-8f5f2617227e tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ef7a5426-c117-40f2-972d-8f5f2617227e tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ef7a5426-c117-40f2-972d-8f5f2617227e tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ef7a5426-c117-40f2-972d-8f5f2617227e tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ef7a5426-c117-40f2-972d-8f5f2617227e tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ef7a5426-c117-40f2-972d-8f5f2617227e tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:06 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-ef7a5426-c117-40f2-972d-8f5f2617227e tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054864 Apr 14 10:50:06 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 144/432] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:50:06 2023] GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:50:08 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-cd7ef211-ef9a-48a2-9e71-50c46c9f5f3f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:08 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-cd7ef211-ef9a-48a2-9e71-50c46c9f5f3f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-cd7ef211-ef9a-48a2-9e71-50c46c9f5f3f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-cd7ef211-ef9a-48a2-9e71-50c46c9f5f3f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-cd7ef211-ef9a-48a2-9e71-50c46c9f5f3f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-cd7ef211-ef9a-48a2-9e71-50c46c9f5f3f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-cd7ef211-ef9a-48a2-9e71-50c46c9f5f3f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-cd7ef211-ef9a-48a2-9e71-50c46c9f5f3f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:08 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-cd7ef211-ef9a-48a2-9e71-50c46c9f5f3f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:50:08 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-cd7ef211-ef9a-48a2-9e71-50c46c9f5f3f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade" status: 200 len: 1503 microversion: 2.1 time: 0.180112 Apr 14 10:50:08 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 141/433] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:50:08 2023] GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:50:11 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e1033d75-fd4f-4f12-b066-20efda0cb175 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:11 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-e1033d75-fd4f-4f12-b066-20efda0cb175 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e1033d75-fd4f-4f12-b066-20efda0cb175 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e1033d75-fd4f-4f12-b066-20efda0cb175 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e1033d75-fd4f-4f12-b066-20efda0cb175 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e1033d75-fd4f-4f12-b066-20efda0cb175 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e1033d75-fd4f-4f12-b066-20efda0cb175 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e1033d75-fd4f-4f12-b066-20efda0cb175 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:11 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-e1033d75-fd4f-4f12-b066-20efda0cb175 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] HTTP exception thrown: Instance 39586d44-1d8e-4607-ab4d-c03a7d841606 could not be found. Apr 14 10:50:11 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e1033d75-fd4f-4f12-b066-20efda0cb175 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Request method failure captured: Apr 14 10:50:11 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606 HTTP/1.1 Apr 14 10:50:11 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:50:11 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:50:11 user devstack@n-api.service[61841]: Connection: close Apr 14 10:50:11 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 10:50:11 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:50:11 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:50:11 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:50:11 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:50:11 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS5PpmYTh8KkdcVQ1LNsXqxawEoPBjTKKjz3BZP5qlLuhZ_IgW-7uAt6Do4owSlE43-0hiCrjxYusuntJ3XoXIALE4L_ouT41JWxDmc-4rXWHTewRwUvHHW_tOo2veFM4gY3GVNM0cliOATwCRpsjud1VRt50eRJj8uikPjbXQW9OoU Apr 14 10:50:11 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:50:11 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:50:11 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:50:11 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:50:11 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:50:11 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:50:11 user devstack@n-api.service[61841]: X-Project-Id: 340e1e1695464eb5ad8a8c881cf24611 Apr 14 10:50:11 user devstack@n-api.service[61841]: X-Project-Name: tempest-TestShelveInstance-1930659141 Apr 14 10:50:11 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:50:11 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:50:11 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/340e1e1695464eb5ad8a8c881cf24611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/340e1e1695464eb5ad8a8c881cf24611"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/340e1e1695464eb5ad8a8c881cf24611"}]}] Apr 14 10:50:11 user devstack@n-api.service[61841]: X-Tenant: tempest-TestShelveInstance-1930659141 Apr 14 10:50:11 user devstack@n-api.service[61841]: X-Tenant-Id: 340e1e1695464eb5ad8a8c881cf24611 Apr 14 10:50:11 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-TestShelveInstance-1930659141 Apr 14 10:50:11 user devstack@n-api.service[61841]: X-User: tempest-TestShelveInstance-1930659141-project-member Apr 14 10:50:11 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:50:11 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:50:11 user devstack@n-api.service[61841]: X-User-Id: 15c4ab86a8d244c4be5889b4ac47561a Apr 14 10:50:11 user devstack@n-api.service[61841]: X-User-Name: tempest-TestShelveInstance-1930659141-project-member Apr 14 10:50:11 user devstack@n-api.service[61841]: method: > Apr 14 10:50:11 user devstack@n-api.service[61841]: exception: Instance 39586d44-1d8e-4607-ab4d-c03a7d841606 could not be found. Apr 14 10:50:11 user devstack@n-api.service[61841]: action_args: {'id': '39586d44-1d8e-4607-ab4d-c03a7d841606'} Apr 14 10:50:11 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39586d44-1d8e-4607-ab4d-c03a7d841606 could not be found. Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39586d44-1d8e-4607-ab4d-c03a7d841606 could not be found. Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39586d44-1d8e-4607-ab4d-c03a7d841606 could not be found. Apr 14 10:50:11 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:50:11 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e1033d75-fd4f-4f12-b066-20efda0cb175 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Returning 404 to user: Instance 39586d44-1d8e-4607-ab4d-c03a7d841606 could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:50:11 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-e1033d75-fd4f-4f12-b066-20efda0cb175 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 10.0.0.210 "GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606" status: 404 len: 111 microversion: 2.1 time: 0.037385 Apr 14 10:50:11 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 149/434] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:50:11 2023] GET /compute/v2.1/servers/39586d44-1d8e-4607-ab4d-c03a7d841606 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:50:11 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-b714f050-ea45-4cbb-b73a-b3686e0c95aa tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Calling method '.version_select at 0x7fcd1d127520>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:11 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-b714f050-ea45-4cbb-b73a-b3686e0c95aa tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-261961953" status: 202 len: 0 microversion: 2.1 time: 0.025934 Apr 14 10:50:11 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 145/435] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 10:50:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-261961953 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:50:13 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-6e1cc0be-cd62-4298-8ab0-5131cc6dc117 tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6a302d4c-eeea-4677-8a86-1a9ee9a0ec0a"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:13 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-6e1cc0be-cd62-4298-8ab0-5131cc6dc117 tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6e1cc0be-cd62-4298-8ab0-5131cc6dc117 tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6e1cc0be-cd62-4298-8ab0-5131cc6dc117 tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6e1cc0be-cd62-4298-8ab0-5131cc6dc117 tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6e1cc0be-cd62-4298-8ab0-5131cc6dc117 tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6e1cc0be-cd62-4298-8ab0-5131cc6dc117 tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6e1cc0be-cd62-4298-8ab0-5131cc6dc117 tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-6e1cc0be-cd62-4298-8ab0-5131cc6dc117 tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] HTTP exception thrown: Volume 6a302d4c-eeea-4677-8a86-1a9ee9a0ec0a could not be found. Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-6e1cc0be-cd62-4298-8ab0-5131cc6dc117 tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Request method failure captured: Apr 14 10:50:14 user devstack@n-api.service[61839]: request: PUT /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/os-volume_attachments/3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 HTTP/1.1 Apr 14 10:50:14 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:50:14 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:50:14 user devstack@n-api.service[61839]: Connection: close Apr 14 10:50:14 user devstack@n-api.service[61839]: Content-Length: 74 Apr 14 10:50:14 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:50:14 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:50:14 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:50:14 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:50:14 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS9pqMQEl-6gOWHM7Apv50bU7BjZ3SO-V9rON5jLvoD3DlwFfBOhNglqNp0P5i06Hf6CELbKJtmmLyeIDi-4QRyVINBLQjkF8bn-hrToXQppf8iMP8KYDqGmyFHYj3ugQgNJGPwxTjwG-ZGwK_RE9KyFO-ThlIkZFzUdXKrVbqoSOo4 Apr 14 10:50:14 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:50:14 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:50:14 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:50:14 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:50:14 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:50:14 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:50:14 user devstack@n-api.service[61839]: X-Project-Id: cfd720d22714450094bb4bb180830245 Apr 14 10:50:14 user devstack@n-api.service[61839]: X-Project-Name: tempest-VolumesAdminNegativeTest-1105748712 Apr 14 10:50:14 user devstack@n-api.service[61839]: X-Role: member,admin,reader Apr 14 10:50:14 user devstack@n-api.service[61839]: X-Roles: member,admin,reader Apr 14 10:50:14 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cfd720d22714450094bb4bb180830245"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cfd720d22714450094bb4bb180830245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cfd720d22714450094bb4bb180830245"}]}] Apr 14 10:50:14 user devstack@n-api.service[61839]: X-Tenant: tempest-VolumesAdminNegativeTest-1105748712 Apr 14 10:50:14 user devstack@n-api.service[61839]: X-Tenant-Id: cfd720d22714450094bb4bb180830245 Apr 14 10:50:14 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1105748712 Apr 14 10:50:14 user devstack@n-api.service[61839]: X-User: tempest-VolumesAdminNegativeTest-1105748712-project-admin Apr 14 10:50:14 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:50:14 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:50:14 user devstack@n-api.service[61839]: X-User-Id: 1b1e48eda4ea480a8a19bdd28338b6ce Apr 14 10:50:14 user devstack@n-api.service[61839]: X-User-Name: tempest-VolumesAdminNegativeTest-1105748712-project-admin Apr 14 10:50:14 user devstack@n-api.service[61839]: Apr 14 10:50:14 user devstack@n-api.service[61839]: {"volumeAttachment": {"volumeId": "6a302d4c-eeea-4677-8a86-1a9ee9a0ec0a"}} Apr 14 10:50:14 user devstack@n-api.service[61839]: method: > Apr 14 10:50:14 user devstack@n-api.service[61839]: exception: Volume 6a302d4c-eeea-4677-8a86-1a9ee9a0ec0a could not be found. Apr 14 10:50:14 user devstack@n-api.service[61839]: action_args: {'server_id': 'f3245b74-dbe8-4b8b-83b6-58a4811fdba9', 'id': '3d9a98d6-ea02-4e9e-8af7-d744d734e3e9', 'body': {'volumeAttachment': {'volumeId': '6a302d4c-eeea-4677-8a86-1a9ee9a0ec0a'}}} Apr 14 10:50:14 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6a302d4c-eeea-4677-8a86-1a9ee9a0ec0a could not be found. (HTTP 404) (Request-ID: req-541772e5-6fd8-4607-8bc3-317b4e38f33b) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6a302d4c-eeea-4677-8a86-1a9ee9a0ec0a could not be found. Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 6a302d4c-eeea-4677-8a86-1a9ee9a0ec0a could not be found. Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6a302d4c-eeea-4677-8a86-1a9ee9a0ec0a could not be found. Apr 14 10:50:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-6e1cc0be-cd62-4298-8ab0-5131cc6dc117 tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Returning 400 to user: Volume 6a302d4c-eeea-4677-8a86-1a9ee9a0ec0a could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:50:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-6e1cc0be-cd62-4298-8ab0-5131cc6dc117 tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/os-volume_attachments/3d9a98d6-ea02-4e9e-8af7-d744d734e3e9" status: 400 len: 107 microversion: 2.1 time: 0.242516 Apr 14 10:50:14 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 142/436] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 10:50:13 2023] PUT /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/os-volume_attachments/3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 => generated 107 bytes in 244 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:14 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-4b65689b-336b-4d2b-9905-4f7759658de4 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '.version_select at 0x7fcd1d02b490>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG nova.objects.instance [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lazy-loading 'services' on Instance uuid f3245b74-dbe8-4b8b-83b6-58a4811fdba9 {{(pid=61841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:50:14 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/os-volume_attachments/3d9a98d6-ea02-4e9e-8af7-d744d734e3e9" status: 202 len: 0 microversion: 2.1 time: 0.234694 Apr 14 10:50:14 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 150/437] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:50:14 2023] DELETE /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/os-volume_attachments/3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-3d9bb39e-f7e5-493b-90b4-1900fa511f67 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-3d9bb39e-f7e5-493b-90b4-1900fa511f67 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3d9bb39e-f7e5-493b-90b4-1900fa511f67 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3d9bb39e-f7e5-493b-90b4-1900fa511f67 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3d9bb39e-f7e5-493b-90b4-1900fa511f67 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3d9bb39e-f7e5-493b-90b4-1900fa511f67 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3d9bb39e-f7e5-493b-90b4-1900fa511f67 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3d9bb39e-f7e5-493b-90b4-1900fa511f67 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-3d9bb39e-f7e5-493b-90b4-1900fa511f67 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067434 Apr 14 10:50:14 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 143/438] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:50:14 2023] GET /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:50:14 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-4b65689b-336b-4d2b-9905-4f7759658de4 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/aefc0dd9-6bb6-4a2f-ada9-e21b5f4d6151" status: 204 len: 0 microversion: 2.1 time: 0.292478 Apr 14 10:50:14 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 146/439] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:50:14 2023] DELETE /compute/v2.1/images/aefc0dd9-6bb6-4a2f-ada9-e21b5f4d6151 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:14 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:50:14 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce" status: 204 len: 0 microversion: 2.1 time: 0.132182 Apr 14 10:50:14 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 151/440] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:50:14 2023] DELETE /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-429d9f8d-13c7-41de-a970-125fdc81c83b tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-429d9f8d-13c7-41de-a970-125fdc81c83b tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-429d9f8d-13c7-41de-a970-125fdc81c83b tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-429d9f8d-13c7-41de-a970-125fdc81c83b tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-429d9f8d-13c7-41de-a970-125fdc81c83b tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-429d9f8d-13c7-41de-a970-125fdc81c83b tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-429d9f8d-13c7-41de-a970-125fdc81c83b tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-429d9f8d-13c7-41de-a970-125fdc81c83b tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:14 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-429d9f8d-13c7-41de-a970-125fdc81c83b tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7212c3fe50ef465c99a0eefec4cbd753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482809b9148e408b84b156802a21a225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:50:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-429d9f8d-13c7-41de-a970-125fdc81c83b tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce" status: 200 len: 1677 microversion: 2.1 time: 0.258065 Apr 14 10:50:14 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 144/441] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:50:14 2023] GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce => generated 1677 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:50:14 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-328586b9-b096-498a-8dd9-49db297cc260 req-5bdd6b15-8d52-4d67-bb4c-0464f8455c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "name": "network-vif-unplugged", "status": "completed", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:15 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:50:15 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-328586b9-b096-498a-8dd9-49db297cc260 req-5bdd6b15-8d52-4d67-bb4c-0464f8455c0a service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:15 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-328586b9-b096-498a-8dd9-49db297cc260 req-5bdd6b15-8d52-4d67-bb4c-0464f8455c0a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:15 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-328586b9-b096-498a-8dd9-49db297cc260 req-5bdd6b15-8d52-4d67-bb4c-0464f8455c0a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:15 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:50:15 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-328586b9-b096-498a-8dd9-49db297cc260 req-5bdd6b15-8d52-4d67-bb4c-0464f8455c0a service nova] Creating event network-vif-unplugged:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:50:15 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-328586b9-b096-498a-8dd9-49db297cc260 req-5bdd6b15-8d52-4d67-bb4c-0464f8455c0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054277 Apr 14 10:50:15 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 147/442] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:50:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-632123778", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8"}]}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:17 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-2bba90a6-f16e-4cf0-9c92-3ef64bd77bbd req-e5786353-c4a5-4615-8f67-01c9f7d2eb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "name": "network-vif-plugged", "status": "completed", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2bba90a6-f16e-4cf0-9c92-3ef64bd77bbd req-e5786353-c4a5-4615-8f67-01c9f7d2eb06 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2bba90a6-f16e-4cf0-9c92-3ef64bd77bbd req-e5786353-c4a5-4615-8f67-01c9f7d2eb06 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2bba90a6-f16e-4cf0-9c92-3ef64bd77bbd req-e5786353-c4a5-4615-8f67-01c9f7d2eb06 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:17 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-2bba90a6-f16e-4cf0-9c92-3ef64bd77bbd req-e5786353-c4a5-4615-8f67-01c9f7d2eb06 service nova] Creating event network-vif-plugged:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:50:17 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-2bba90a6-f16e-4cf0-9c92-3ef64bd77bbd req-e5786353-c4a5-4615-8f67-01c9f7d2eb06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034319 Apr 14 10:50:17 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 145/443] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:50:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG nova.network.neutron [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] validate_networks() for [('07f1f39e-292a-4e73-b4ed-99e5799d6fa8', None, None, None, None, None)] {{(pid=61841) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:50:17 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-557a5089-3068-4a17-8d9f-147b9edb050f req-5d32ae89-a870-40b3-8c82-66b75f47703a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6c800c-9b35-4e35-969e-c40367056dce", "name": "network-vif-deleted", "tag": "49978689-84ce-4422-add9-9bb12f628c37"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-557a5089-3068-4a17-8d9f-147b9edb050f req-5d32ae89-a870-40b3-8c82-66b75f47703a service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-557a5089-3068-4a17-8d9f-147b9edb050f req-5d32ae89-a870-40b3-8c82-66b75f47703a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-557a5089-3068-4a17-8d9f-147b9edb050f req-5d32ae89-a870-40b3-8c82-66b75f47703a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:17 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-557a5089-3068-4a17-8d9f-147b9edb050f req-5d32ae89-a870-40b3-8c82-66b75f47703a service nova] Creating event network-vif-deleted:49978689-84ce-4422-add9-9bb12f628c37 for instance 0e6c800c-9b35-4e35-969e-c40367056dce on user Apr 14 10:50:17 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-557a5089-3068-4a17-8d9f-147b9edb050f req-5d32ae89-a870-40b3-8c82-66b75f47703a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032257 Apr 14 10:50:17 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 148/444] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:50:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting quotas for project 71289f80a05141f482cb538dac3d7b38. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting quotas for user 395bc9d7007c4e01ac7effd418bcea19 and project 71289f80a05141f482cb538dac3d7b38. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Going to run 1 instances... {{(pid=61841) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:50:17 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61841) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:50:17 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.675495 Apr 14 10:50:17 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 152/445] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 10:50:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 10:50:17 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-e50ee630-035f-435d-9d45-68c4c654cefe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:17 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-e50ee630-035f-435d-9d45-68c4c654cefe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:17 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-e50ee630-035f-435d-9d45-68c4c654cefe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:50:17 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-e50ee630-035f-435d-9d45-68c4c654cefe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:50:17 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-e50ee630-035f-435d-9d45-68c4c654cefe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:50:17 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-e50ee630-035f-435d-9d45-68c4c654cefe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416" status: 200 len: 1394 microversion: 2.87 time: 0.081518 Apr 14 10:50:17 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 146/446] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:50:17 2023] GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416 => generated 1394 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:50:20 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-361cbaaa-28d1-4635-b511-f1e00eda1082 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:20 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-361cbaaa-28d1-4635-b511-f1e00eda1082 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-361cbaaa-28d1-4635-b511-f1e00eda1082 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-361cbaaa-28d1-4635-b511-f1e00eda1082 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-361cbaaa-28d1-4635-b511-f1e00eda1082 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-361cbaaa-28d1-4635-b511-f1e00eda1082 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-361cbaaa-28d1-4635-b511-f1e00eda1082 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-361cbaaa-28d1-4635-b511-f1e00eda1082 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:20 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-667819f2-e475-4cde-a630-d91f5236db9c req-26e2f80c-a952-486e-829f-b49416653396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cae9f61-763f-4671-a873-d15f01384416", "tag": "30d57100-3321-41fe-9335-d53c8c5e291c"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-667819f2-e475-4cde-a630-d91f5236db9c req-26e2f80c-a952-486e-829f-b49416653396 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-667819f2-e475-4cde-a630-d91f5236db9c req-26e2f80c-a952-486e-829f-b49416653396 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-667819f2-e475-4cde-a630-d91f5236db9c req-26e2f80c-a952-486e-829f-b49416653396 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:20 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-667819f2-e475-4cde-a630-d91f5236db9c req-26e2f80c-a952-486e-829f-b49416653396 service nova] Creating event network-changed:30d57100-3321-41fe-9335-d53c8c5e291c for instance 6cae9f61-763f-4671-a873-d15f01384416 on user Apr 14 10:50:20 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-667819f2-e475-4cde-a630-d91f5236db9c req-26e2f80c-a952-486e-829f-b49416653396 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034456 Apr 14 10:50:20 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 153/447] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:50:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:50:20 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-361cbaaa-28d1-4635-b511-f1e00eda1082 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:50:20 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-361cbaaa-28d1-4635-b511-f1e00eda1082 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871" status: 200 len: 1687 microversion: 2.1 time: 0.157578 Apr 14 10:50:20 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 149/448] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:50:20 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:50:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-4cb990df-5689-4607-8511-a7f445768520 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:22 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-4cb990df-5689-4607-8511-a7f445768520 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4cb990df-5689-4607-8511-a7f445768520 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4cb990df-5689-4607-8511-a7f445768520 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4cb990df-5689-4607-8511-a7f445768520 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4cb990df-5689-4607-8511-a7f445768520 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4cb990df-5689-4607-8511-a7f445768520 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4cb990df-5689-4607-8511-a7f445768520 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:22 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-4cb990df-5689-4607-8511-a7f445768520 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045169 Apr 14 10:50:22 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 147/449] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:50:22 2023] GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:50:29 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:50:29 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:50:29 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-d7d2ff93-790d-4700-b265-8192b30d0290 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:29 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-d7d2ff93-790d-4700-b265-8192b30d0290 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:29 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:50:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d7d2ff93-790d-4700-b265-8192b30d0290 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d7d2ff93-790d-4700-b265-8192b30d0290 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d7d2ff93-790d-4700-b265-8192b30d0290 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d7d2ff93-790d-4700-b265-8192b30d0290 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d7d2ff93-790d-4700-b265-8192b30d0290 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d7d2ff93-790d-4700-b265-8192b30d0290 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:29 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:50:29 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-d7d2ff93-790d-4700-b265-8192b30d0290 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060067 Apr 14 10:50:29 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 154/450] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:50:29 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:50:29 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-2080d257-b66a-48b6-a6ef-9ab1116cbb02 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:29 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-2080d257-b66a-48b6-a6ef-9ab1116cbb02 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2080d257-b66a-48b6-a6ef-9ab1116cbb02 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2080d257-b66a-48b6-a6ef-9ab1116cbb02 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2080d257-b66a-48b6-a6ef-9ab1116cbb02 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2080d257-b66a-48b6-a6ef-9ab1116cbb02 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2080d257-b66a-48b6-a6ef-9ab1116cbb02 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2080d257-b66a-48b6-a6ef-9ab1116cbb02 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:29 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-2080d257-b66a-48b6-a6ef-9ab1116cbb02 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:50:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-2080d257-b66a-48b6-a6ef-9ab1116cbb02 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1676 microversion: 2.1 time: 0.142076 Apr 14 10:50:29 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 150/451] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:50:29 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1676 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:50:29 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-c7ddd057-f002-4c55-8be9-28847b6d8c73 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:29 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-c7ddd057-f002-4c55-8be9-28847b6d8c73 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:29 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:50:29 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=27 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:50:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c7ddd057-f002-4c55-8be9-28847b6d8c73 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c7ddd057-f002-4c55-8be9-28847b6d8c73 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c7ddd057-f002-4c55-8be9-28847b6d8c73 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c7ddd057-f002-4c55-8be9-28847b6d8c73 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c7ddd057-f002-4c55-8be9-28847b6d8c73 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c7ddd057-f002-4c55-8be9-28847b6d8c73 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:29 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=46,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:50:29 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-c7ddd057-f002-4c55-8be9-28847b6d8c73 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:50:29 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-c7ddd057-f002-4c55-8be9-28847b6d8c73 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1676 microversion: 2.1 time: 0.150120 Apr 14 10:50:29 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 148/452] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:50:29 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:50:30 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-601c200e-ae64-4d8a-b8ee-5b6f7fd52df3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:30 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-601c200e-ae64-4d8a-b8ee-5b6f7fd52df3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-601c200e-ae64-4d8a-b8ee-5b6f7fd52df3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-601c200e-ae64-4d8a-b8ee-5b6f7fd52df3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-601c200e-ae64-4d8a-b8ee-5b6f7fd52df3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-601c200e-ae64-4d8a-b8ee-5b6f7fd52df3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-601c200e-ae64-4d8a-b8ee-5b6f7fd52df3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-601c200e-ae64-4d8a-b8ee-5b6f7fd52df3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:30 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-601c200e-ae64-4d8a-b8ee-5b6f7fd52df3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:50:30 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-601c200e-ae64-4d8a-b8ee-5b6f7fd52df3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1676 microversion: 2.1 time: 0.170807 Apr 14 10:50:30 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 155/453] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:50:30 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:50:33 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-18085e69-9edd-4cdb-babf-8086b8f77640 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:33 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-18085e69-9edd-4cdb-babf-8086b8f77640 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:33 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-cda71c00-b088-4e3d-8576-32eba60207d7 req-b39c46ab-c8cb-497f-9db2-86e4905b3903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cae9f61-763f-4671-a873-d15f01384416", "name": "network-vif-plugged", "status": "completed", "tag": "30d57100-3321-41fe-9335-d53c8c5e291c"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-18085e69-9edd-4cdb-babf-8086b8f77640 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-18085e69-9edd-4cdb-babf-8086b8f77640 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-18085e69-9edd-4cdb-babf-8086b8f77640 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-18085e69-9edd-4cdb-babf-8086b8f77640 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-18085e69-9edd-4cdb-babf-8086b8f77640 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:33 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-18085e69-9edd-4cdb-babf-8086b8f77640 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cda71c00-b088-4e3d-8576-32eba60207d7 req-b39c46ab-c8cb-497f-9db2-86e4905b3903 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cda71c00-b088-4e3d-8576-32eba60207d7 req-b39c46ab-c8cb-497f-9db2-86e4905b3903 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cda71c00-b088-4e3d-8576-32eba60207d7 req-b39c46ab-c8cb-497f-9db2-86e4905b3903 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:33 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-cda71c00-b088-4e3d-8576-32eba60207d7 req-b39c46ab-c8cb-497f-9db2-86e4905b3903 service nova] Creating event network-vif-plugged:30d57100-3321-41fe-9335-d53c8c5e291c for instance 6cae9f61-763f-4671-a873-d15f01384416 on user Apr 14 10:50:33 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-cda71c00-b088-4e3d-8576-32eba60207d7 req-b39c46ab-c8cb-497f-9db2-86e4905b3903 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043473 Apr 14 10:50:33 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 149/454] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:50:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:50:34 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-18085e69-9edd-4cdb-babf-8086b8f77640 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:50:34 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-18085e69-9edd-4cdb-babf-8086b8f77640 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:50:34 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-18085e69-9edd-4cdb-babf-8086b8f77640 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:50:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-18085e69-9edd-4cdb-babf-8086b8f77640 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae" status: 200 len: 1784 microversion: 2.20 time: 0.267638 Apr 14 10:50:34 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 151/455] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:50:33 2023] GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae => generated 1784 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:50:35 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-1b837f95-7f1e-45b7-ad93-d5c5499cc99e req-a57215a4-c2b7-48fd-ba1f-451b04f8cd89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cae9f61-763f-4671-a873-d15f01384416", "name": "network-vif-plugged", "status": "completed", "tag": "30d57100-3321-41fe-9335-d53c8c5e291c"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-1b837f95-7f1e-45b7-ad93-d5c5499cc99e req-a57215a4-c2b7-48fd-ba1f-451b04f8cd89 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-1b837f95-7f1e-45b7-ad93-d5c5499cc99e req-a57215a4-c2b7-48fd-ba1f-451b04f8cd89 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-1b837f95-7f1e-45b7-ad93-d5c5499cc99e req-a57215a4-c2b7-48fd-ba1f-451b04f8cd89 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:35 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-1b837f95-7f1e-45b7-ad93-d5c5499cc99e req-a57215a4-c2b7-48fd-ba1f-451b04f8cd89 service nova] Creating event network-vif-plugged:30d57100-3321-41fe-9335-d53c8c5e291c for instance 6cae9f61-763f-4671-a873-d15f01384416 on user Apr 14 10:50:35 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-1b837f95-7f1e-45b7-ad93-d5c5499cc99e req-a57215a4-c2b7-48fd-ba1f-451b04f8cd89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038611 Apr 14 10:50:35 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 156/456] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:50:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:50:43 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-d059d75c-d14a-4ba0-b520-b38e8364f18b req-ec4fc498-da02-4903-8c93-f7503bf9c7bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55178126-9766-4875-9122-39dcc87ce82c", "tag": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-d059d75c-d14a-4ba0-b520-b38e8364f18b req-ec4fc498-da02-4903-8c93-f7503bf9c7bc service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-d059d75c-d14a-4ba0-b520-b38e8364f18b req-ec4fc498-da02-4903-8c93-f7503bf9c7bc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-d059d75c-d14a-4ba0-b520-b38e8364f18b req-ec4fc498-da02-4903-8c93-f7503bf9c7bc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:43 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-d059d75c-d14a-4ba0-b520-b38e8364f18b req-ec4fc498-da02-4903-8c93-f7503bf9c7bc service nova] Creating event network-changed:578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance 55178126-9766-4875-9122-39dcc87ce82c on user Apr 14 10:50:43 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-d059d75c-d14a-4ba0-b520-b38e8364f18b req-ec4fc498-da02-4903-8c93-f7503bf9c7bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031502 Apr 14 10:50:43 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 150/457] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:50:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:50:46 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:46 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:46 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=9 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:50:46 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=21 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:50:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:46 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Going to try to terminate instance {{(pid=61840) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:50:46 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c" status: 204 len: 0 microversion: 2.1 time: 0.326396 Apr 14 10:50:46 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 152/458] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:50:46 2023] DELETE /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 14 10:50:46 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=5 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:50:46 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=13 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:50:46 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a3319ff0-61c8-40ac-966e-ee3a1bf95673 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:46 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-a3319ff0-61c8-40ac-966e-ee3a1bf95673 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3319ff0-61c8-40ac-966e-ee3a1bf95673 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3319ff0-61c8-40ac-966e-ee3a1bf95673 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3319ff0-61c8-40ac-966e-ee3a1bf95673 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3319ff0-61c8-40ac-966e-ee3a1bf95673 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3319ff0-61c8-40ac-966e-ee3a1bf95673 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3319ff0-61c8-40ac-966e-ee3a1bf95673 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:46 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-a3319ff0-61c8-40ac-966e-ee3a1bf95673 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ed4663d8984fe7b5d95616281bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1696bf804b2e4d7f86162513015c8e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:50:46 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a3319ff0-61c8-40ac-966e-ee3a1bf95673 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c" status: 200 len: 1573 microversion: 2.1 time: 0.235414 Apr 14 10:50:46 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 157/459] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:50:46 2023] GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c => generated 1573 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:50:47 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-3687208b-0054-4721-b4b3-8f83fa78e835 req-eb6e7dba-0b63-4f05-b1f7-4a4648116485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55178126-9766-4875-9122-39dcc87ce82c", "name": "network-vif-unplugged", "status": "completed", "tag": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-3687208b-0054-4721-b4b3-8f83fa78e835 req-eb6e7dba-0b63-4f05-b1f7-4a4648116485 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-3687208b-0054-4721-b4b3-8f83fa78e835 req-eb6e7dba-0b63-4f05-b1f7-4a4648116485 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-3687208b-0054-4721-b4b3-8f83fa78e835 req-eb6e7dba-0b63-4f05-b1f7-4a4648116485 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:47 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-3687208b-0054-4721-b4b3-8f83fa78e835 req-eb6e7dba-0b63-4f05-b1f7-4a4648116485 service nova] Creating event network-vif-unplugged:578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance 55178126-9766-4875-9122-39dcc87ce82c on user Apr 14 10:50:47 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-3687208b-0054-4721-b4b3-8f83fa78e835 req-eb6e7dba-0b63-4f05-b1f7-4a4648116485 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036817 Apr 14 10:50:47 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 151/460] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:50:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:50:47 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-78870563-9c59-4fd7-b7b9-eff210605ae5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:50:47 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-78870563-9c59-4fd7-b7b9-eff210605ae5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:50:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-78870563-9c59-4fd7-b7b9-eff210605ae5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-78870563-9c59-4fd7-b7b9-eff210605ae5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-78870563-9c59-4fd7-b7b9-eff210605ae5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-78870563-9c59-4fd7-b7b9-eff210605ae5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-78870563-9c59-4fd7-b7b9-eff210605ae5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-78870563-9c59-4fd7-b7b9-eff210605ae5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:47 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-78870563-9c59-4fd7-b7b9-eff210605ae5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] HTTP exception thrown: Instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 could not be found. Apr 14 10:50:47 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-78870563-9c59-4fd7-b7b9-eff210605ae5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Request method failure captured: Apr 14 10:50:47 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 HTTP/1.1 Apr 14 10:50:47 user devstack@n-api.service[61840]: Accept: application/json Apr 14 10:50:47 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 10:50:47 user devstack@n-api.service[61840]: Connection: close Apr 14 10:50:47 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 10:50:47 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 10:50:47 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 10:50:47 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 10:50:47 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 10:50:47 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS9B1m0NjVHQTI-GqSMe1S0iDS9dg5yDlJN7cAobuIhhvHVE8vH708pJ-pPKz1M2iEly1Sh9OVk5eFKG4vlxTsXtI-IozpNXpTa-FkPkRt-aGyFI-R1QLjnuh9pGZEUyR6rVwHawJ6Ih0-6gJe27LrheIKXui5CH_9syFhUK0l-6XDg Apr 14 10:50:47 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 10:50:47 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 10:50:47 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 10:50:47 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 10:50:47 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 10:50:47 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 10:50:47 user devstack@n-api.service[61840]: X-Project-Id: a84a2fac4604454982dc018b36440b00 Apr 14 10:50:47 user devstack@n-api.service[61840]: X-Project-Name: tempest-VolumesSnapshotTestJSON-685456681 Apr 14 10:50:47 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 10:50:47 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 10:50:47 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a84a2fac4604454982dc018b36440b00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a84a2fac4604454982dc018b36440b00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a84a2fac4604454982dc018b36440b00"}]}] Apr 14 10:50:47 user devstack@n-api.service[61840]: X-Tenant: tempest-VolumesSnapshotTestJSON-685456681 Apr 14 10:50:47 user devstack@n-api.service[61840]: X-Tenant-Id: a84a2fac4604454982dc018b36440b00 Apr 14 10:50:47 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-685456681 Apr 14 10:50:47 user devstack@n-api.service[61840]: X-User: tempest-VolumesSnapshotTestJSON-685456681-project-member Apr 14 10:50:47 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 10:50:47 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 10:50:47 user devstack@n-api.service[61840]: X-User-Id: ac498c56dae543cf9e64fbb61ad50df3 Apr 14 10:50:47 user devstack@n-api.service[61840]: X-User-Name: tempest-VolumesSnapshotTestJSON-685456681-project-member Apr 14 10:50:47 user devstack@n-api.service[61840]: method: > Apr 14 10:50:47 user devstack@n-api.service[61840]: exception: Instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 could not be found. Apr 14 10:50:47 user devstack@n-api.service[61840]: action_args: {'id': '203b622c-9e6d-4ac7-a3fa-9f9c82ef3108'} Apr 14 10:50:47 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 could not be found. Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 could not be found. Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 could not be found. Apr 14 10:50:47 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:50:47 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-78870563-9c59-4fd7-b7b9-eff210605ae5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Returning 404 to user: Instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:50:47 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-78870563-9c59-4fd7-b7b9-eff210605ae5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" status: 404 len: 111 microversion: 2.1 time: 0.048016 Apr 14 10:50:47 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 153/461] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:50:47 2023] GET /compute/v2.1/servers/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:50:48 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-d4441180-ab1a-40d4-821e-3ce74d69c86e req-5a6b3913-c913-4481-9210-79543576173b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55178126-9766-4875-9122-39dcc87ce82c", "name": "network-vif-deleted", "tag": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-d4441180-ab1a-40d4-821e-3ce74d69c86e req-5a6b3913-c913-4481-9210-79543576173b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-d4441180-ab1a-40d4-821e-3ce74d69c86e req-5a6b3913-c913-4481-9210-79543576173b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-d4441180-ab1a-40d4-821e-3ce74d69c86e req-5a6b3913-c913-4481-9210-79543576173b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:48 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-d4441180-ab1a-40d4-821e-3ce74d69c86e req-5a6b3913-c913-4481-9210-79543576173b service nova] Creating event network-vif-deleted:578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance 55178126-9766-4875-9122-39dcc87ce82c on user Apr 14 10:50:48 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-d4441180-ab1a-40d4-821e-3ce74d69c86e req-5a6b3913-c913-4481-9210-79543576173b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033099 Apr 14 10:50:48 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 158/462] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:50:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:50:49 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55178126-9766-4875-9122-39dcc87ce82c", "name": "network-vif-plugged", "status": "completed", "tag": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f"}, {"server_uuid": "55178126-9766-4875-9122-39dcc87ce82c", "name": "network-vif-plugged", "status": "completed", "tag": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f"}, {"server_uuid": "55178126-9766-4875-9122-39dcc87ce82c", "name": "network-vif-plugged", "status": "completed", "tag": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f"}, {"server_uuid": "55178126-9766-4875-9122-39dcc87ce82c", "name": "network-vif-plugged", "status": "completed", "tag": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:50:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:50:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:50:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:50:49 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Creating event network-vif-plugged:578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance 55178126-9766-4875-9122-39dcc87ce82c on user Apr 14 10:50:49 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Creating event network-vif-plugged:578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance 55178126-9766-4875-9122-39dcc87ce82c on user Apr 14 10:50:49 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Creating event network-vif-plugged:578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance 55178126-9766-4875-9122-39dcc87ce82c on user Apr 14 10:50:49 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Creating event network-vif-plugged:578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance 55178126-9766-4875-9122-39dcc87ce82c on user Apr 14 10:50:49 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.049375 Apr 14 10:50:49 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 152/463] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:50:49 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1661573828", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "networks": [{"uuid": "4efde76c-8493-4902-a655-f10faee002a4"}]}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] validate_networks() for [('4efde76c-8493-4902-a655-f10faee002a4', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Getting quotas for project a84a2fac4604454982dc018b36440b00. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Getting quotas for user ac498c56dae543cf9e64fbb61ad50df3 and project a84a2fac4604454982dc018b36440b00. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:51:01 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:51:01 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.678681 Apr 14 10:51:01 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 154/464] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:51:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:51:01 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:01 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=8 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:01 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a84fa512-0e93-49f1-a639-d17a7bc29d32 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:01 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-a84fa512-0e93-49f1-a639-d17a7bc29d32 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:01 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-a84fa512-0e93-49f1-a639-d17a7bc29d32 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac498c56dae543cf9e64fbb61ad50df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84a2fac4604454982dc018b36440b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:51:01 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a84fa512-0e93-49f1-a639-d17a7bc29d32 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" status: 200 len: 1213 microversion: 2.1 time: 0.070049 Apr 14 10:51:01 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 159/465] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:51:01 2023] GET /compute/v2.1/servers/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=9 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=13 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-621adf82-ec9b-4f68-9410-609ab1e7a048 req-51fec49a-ea17-4318-8b06-82ae1d640bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d", "tag": "ff9ac514-2d14-4580-8d6a-2c525b72a5db"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-621adf82-ec9b-4f68-9410-609ab1e7a048 req-51fec49a-ea17-4318-8b06-82ae1d640bff service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-621adf82-ec9b-4f68-9410-609ab1e7a048 req-51fec49a-ea17-4318-8b06-82ae1d640bff service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-621adf82-ec9b-4f68-9410-609ab1e7a048 req-51fec49a-ea17-4318-8b06-82ae1d640bff service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:04 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-621adf82-ec9b-4f68-9410-609ab1e7a048 req-51fec49a-ea17-4318-8b06-82ae1d640bff service nova] Creating event network-changed:ff9ac514-2d14-4580-8d6a-2c525b72a5db for instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d on user Apr 14 10:51:04 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-621adf82-ec9b-4f68-9410-609ab1e7a048 req-51fec49a-ea17-4318-8b06-82ae1d640bff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040478 Apr 14 10:51:04 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 153/466] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:04 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-aa73253b-09ca-4d73-8b86-c9805e345b2b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:04 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-aa73253b-09ca-4d73-8b86-c9805e345b2b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aa73253b-09ca-4d73-8b86-c9805e345b2b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aa73253b-09ca-4d73-8b86-c9805e345b2b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aa73253b-09ca-4d73-8b86-c9805e345b2b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aa73253b-09ca-4d73-8b86-c9805e345b2b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aa73253b-09ca-4d73-8b86-c9805e345b2b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aa73253b-09ca-4d73-8b86-c9805e345b2b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:04 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-aa73253b-09ca-4d73-8b86-c9805e345b2b tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045418 Apr 14 10:51:04 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 155/467] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:51:04 2023] GET /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:51:04 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1788483212", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "networks": [{"uuid": "36ccc911-348d-426a-ba7b-a49a0bfb0f97"}]}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:04 user devstack@n-api.service[61841]: DEBUG nova.network.neutron [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] validate_networks() for [('36ccc911-348d-426a-ba7b-a49a0bfb0f97', None, None, None, None, None)] {{(pid=61841) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-ad4db990-47c4-4011-98e1-1ac0897ceb80 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-ad4db990-47c4-4011-98e1-1ac0897ceb80 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ad4db990-47c4-4011-98e1-1ac0897ceb80 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ad4db990-47c4-4011-98e1-1ac0897ceb80 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ad4db990-47c4-4011-98e1-1ac0897ceb80 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ad4db990-47c4-4011-98e1-1ac0897ceb80 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ad4db990-47c4-4011-98e1-1ac0897ceb80 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ad4db990-47c4-4011-98e1-1ac0897ceb80 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:04 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-ad4db990-47c4-4011-98e1-1ac0897ceb80 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] HTTP exception thrown: Instance 0e6c800c-9b35-4e35-969e-c40367056dce could not be found. Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-ad4db990-47c4-4011-98e1-1ac0897ceb80 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Request method failure captured: Apr 14 10:51:04 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce HTTP/1.1 Apr 14 10:51:04 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:51:04 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:51:04 user devstack@n-api.service[61839]: Connection: close Apr 14 10:51:04 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:51:04 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:51:04 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:51:04 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:51:04 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:51:04 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS4nmaJKaNT0t_lS6BRI5ZatrwszstWvm7e8fbAKM7H8lmR-Umk03j6JJE3NOp1kMuHBBguPmZP2jwu9fI8mqvPP-jDaPCu0nb-d4Peht7Zot0UxVB2tLeeSduvlVsku9bWPyX6BHCbqlueVGwXLiFdvrrFjeolbHhw-q3rj7uD_9oQ Apr 14 10:51:04 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:51:04 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:51:04 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:51:04 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:51:04 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:51:04 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:51:04 user devstack@n-api.service[61839]: X-Project-Id: 482809b9148e408b84b156802a21a225 Apr 14 10:51:04 user devstack@n-api.service[61839]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1396047341 Apr 14 10:51:04 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:51:04 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:51:04 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/482809b9148e408b84b156802a21a225"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/482809b9148e408b84b156802a21a225"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/482809b9148e408b84b156802a21a225"}]}] Apr 14 10:51:04 user devstack@n-api.service[61839]: X-Tenant: tempest-ServerStableDeviceRescueTest-1396047341 Apr 14 10:51:04 user devstack@n-api.service[61839]: X-Tenant-Id: 482809b9148e408b84b156802a21a225 Apr 14 10:51:04 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1396047341 Apr 14 10:51:04 user devstack@n-api.service[61839]: X-User: tempest-ServerStableDeviceRescueTest-1396047341-project-member Apr 14 10:51:04 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:51:04 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:51:04 user devstack@n-api.service[61839]: X-User-Id: 7212c3fe50ef465c99a0eefec4cbd753 Apr 14 10:51:04 user devstack@n-api.service[61839]: X-User-Name: tempest-ServerStableDeviceRescueTest-1396047341-project-member Apr 14 10:51:04 user devstack@n-api.service[61839]: method: > Apr 14 10:51:04 user devstack@n-api.service[61839]: exception: Instance 0e6c800c-9b35-4e35-969e-c40367056dce could not be found. Apr 14 10:51:04 user devstack@n-api.service[61839]: action_args: {'id': '0e6c800c-9b35-4e35-969e-c40367056dce'} Apr 14 10:51:04 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6c800c-9b35-4e35-969e-c40367056dce could not be found. Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6c800c-9b35-4e35-969e-c40367056dce could not be found. Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6c800c-9b35-4e35-969e-c40367056dce could not be found. Apr 14 10:51:04 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:51:04 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-ad4db990-47c4-4011-98e1-1ac0897ceb80 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Returning 404 to user: Instance 0e6c800c-9b35-4e35-969e-c40367056dce could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:51:04 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-ad4db990-47c4-4011-98e1-1ac0897ceb80 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce" status: 404 len: 111 microversion: 2.1 time: 0.037779 Apr 14 10:51:04 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 154/468] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:51:04 2023] GET /compute/v2.1/servers/0e6c800c-9b35-4e35-969e-c40367056dce => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:51:05 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-b38ab87d-48ab-4784-8085-f512104e2b77 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Calling method '.version_select at 0x7fcd1d02beb0>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:05 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-b38ab87d-48ab-4784-8085-f512104e2b77 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-882808316" status: 202 len: 0 microversion: 2.1 time: 0.025079 Apr 14 10:51:05 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 156/469] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 10:51:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-882808316 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:51:05 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Flavor limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:51:05 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Image limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:51:05 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Flavor pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:51:05 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Image pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:51:05 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:51:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:05 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Getting quotas for project aca26975e5ad4524b4b1b1ec4335802f. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:51:05 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Getting quotas for user 6adefa90332c42c79a1372258a7be5ab and project aca26975e5ad4524b4b1b1ec4335802f. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:51:05 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Going to run 1 instances... {{(pid=61841) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:51:05 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61841) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:51:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.586255 Apr 14 10:51:05 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 160/470] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:51:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:51:05 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-941b02ad-ca7e-4f05-88b3-33d7b8fcfdee tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:05 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-941b02ad-ca7e-4f05-88b3-33d7b8fcfdee tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:05 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-941b02ad-ca7e-4f05-88b3-33d7b8fcfdee tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6adefa90332c42c79a1372258a7be5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca26975e5ad4524b4b1b1ec4335802f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:51:05 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-941b02ad-ca7e-4f05-88b3-33d7b8fcfdee tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" status: 200 len: 1212 microversion: 2.1 time: 0.102989 Apr 14 10:51:05 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 155/471] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:51:05 2023] GET /compute/v2.1/servers/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 => generated 1212 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:51:06 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-7800ccf9-ff6a-4605-a59e-c7b717897bb3 req-30c5477e-e14f-4046-a5ee-78ac9db065bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d", "name": "network-vif-plugged", "status": "completed", "tag": "ff9ac514-2d14-4580-8d6a-2c525b72a5db"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-7800ccf9-ff6a-4605-a59e-c7b717897bb3 req-30c5477e-e14f-4046-a5ee-78ac9db065bd service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-7800ccf9-ff6a-4605-a59e-c7b717897bb3 req-30c5477e-e14f-4046-a5ee-78ac9db065bd service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-7800ccf9-ff6a-4605-a59e-c7b717897bb3 req-30c5477e-e14f-4046-a5ee-78ac9db065bd service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:06 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-7800ccf9-ff6a-4605-a59e-c7b717897bb3 req-30c5477e-e14f-4046-a5ee-78ac9db065bd service nova] Creating event network-vif-plugged:ff9ac514-2d14-4580-8d6a-2c525b72a5db for instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d on user Apr 14 10:51:06 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-7800ccf9-ff6a-4605-a59e-c7b717897bb3 req-30c5477e-e14f-4046-a5ee-78ac9db065bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035875 Apr 14 10:51:06 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 157/472] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:07 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-d8445ced-e780-4ef0-9001-89dc84370a64 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:07 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-d8445ced-e780-4ef0-9001-89dc84370a64 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d8445ced-e780-4ef0-9001-89dc84370a64 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d8445ced-e780-4ef0-9001-89dc84370a64 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d8445ced-e780-4ef0-9001-89dc84370a64 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d8445ced-e780-4ef0-9001-89dc84370a64 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d8445ced-e780-4ef0-9001-89dc84370a64 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d8445ced-e780-4ef0-9001-89dc84370a64 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:08 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-d8445ced-e780-4ef0-9001-89dc84370a64 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:51:08 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-d8445ced-e780-4ef0-9001-89dc84370a64 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:51:08 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-d8445ced-e780-4ef0-9001-89dc84370a64 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:51:08 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-d8445ced-e780-4ef0-9001-89dc84370a64 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416" status: 200 len: 1769 microversion: 2.87 time: 0.259695 Apr 14 10:51:08 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 161/473] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:51:07 2023] GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416 => generated 1769 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:51:08 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d", "name": "network-vif-plugged", "status": "completed", "tag": "ff9ac514-2d14-4580-8d6a-2c525b72a5db"}, {"name": "network-changed", "server_uuid": "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2", "tag": "2f4949b3-11d4-4970-878c-49a35c428147"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:08 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] Creating event network-vif-plugged:ff9ac514-2d14-4580-8d6a-2c525b72a5db for instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d on user Apr 14 10:51:08 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] Creating event network-changed:2f4949b3-11d4-4970-878c-49a35c428147 for instance 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 on user Apr 14 10:51:08 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.032226 Apr 14 10:51:08 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 156/474] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:08 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:10 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2", "name": "network-vif-plugged", "status": "completed", "tag": "2f4949b3-11d4-4970-878c-49a35c428147"}, {"server_uuid": "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2", "name": "network-vif-plugged", "status": "completed", "tag": "2f4949b3-11d4-4970-878c-49a35c428147"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:10 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] Creating event network-vif-plugged:2f4949b3-11d4-4970-878c-49a35c428147 for instance 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 on user Apr 14 10:51:10 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] Creating event network-vif-plugged:2f4949b3-11d4-4970-878c-49a35c428147 for instance 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 on user Apr 14 10:51:10 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032919 Apr 14 10:51:10 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 158/475] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:51:11 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-21a3516c-78ff-4ba3-8dfc-2cf9c3ad034a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d03c3a0>, body: {"keypair": {"name": "tempest-keypair-1550009007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCWcovyJGJoU2VVqBXHmxw2WqzQwe3JweQ4DFCyMODxzU7SfyIb92ARO4ehF+n8xN2UWQPLSSsVS3f1Va86nHzHvrj9cePHzTOq5SnHeWVBXyUULcZytrQgbP7FG6mgKQ=="}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:11 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-21a3516c-78ff-4ba3-8dfc-2cf9c3ad034a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Getting quotas for project bf93e5dac50342d0b65ef09711401e99. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:51:11 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-21a3516c-78ff-4ba3-8dfc-2cf9c3ad034a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Getting quotas for user e359578dcbb24755a216415053d415ef and project bf93e5dac50342d0b65ef09711401e99. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:51:11 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-21a3516c-78ff-4ba3-8dfc-2cf9c3ad034a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047269 Apr 14 10:51:11 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 162/476] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 10:51:11 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1793508079", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "22eb5f87-be4d-447d-bafe-25e0284ea3ca"}], "security_groups": [{"name": "tempest-securitygroup--1671701905"}], "key_name": "tempest-keypair-1550009007", "user_data": "}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] validate_networks() for [('22eb5f87-be4d-447d-bafe-25e0284ea3ca', None, None, None, None, None)] {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Getting quotas for project bf93e5dac50342d0b65ef09711401e99. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Getting quotas for user e359578dcbb24755a216415053d415ef and project bf93e5dac50342d0b65ef09711401e99. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:51:13 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:51:13 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.821854 Apr 14 10:51:13 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 157/477] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:51:13 2023] POST /compute/v2.1/servers => generated 407 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:51:14 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:14 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:14 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d74f9040-0de8-4f01-8905-bd3f7a610f3d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:14 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-d74f9040-0de8-4f01-8905-bd3f7a610f3d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:14 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-d74f9040-0de8-4f01-8905-bd3f7a610f3d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:51:14 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d74f9040-0de8-4f01-8905-bd3f7a610f3d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" status: 200 len: 1240 microversion: 2.1 time: 0.108717 Apr 14 10:51:14 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 159/478] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:51:14 2023] GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:51:18 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:18 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-7046207a-fa65-42ae-a1f4-5b5a9c6cb134 req-e619fcbb-8fb2-451d-944f-2fc4ebb6c5cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7046207a-fa65-42ae-a1f4-5b5a9c6cb134 req-e619fcbb-8fb2-451d-944f-2fc4ebb6c5cb service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7046207a-fa65-42ae-a1f4-5b5a9c6cb134 req-e619fcbb-8fb2-451d-944f-2fc4ebb6c5cb service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7046207a-fa65-42ae-a1f4-5b5a9c6cb134 req-e619fcbb-8fb2-451d-944f-2fc4ebb6c5cb service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:18 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-7046207a-fa65-42ae-a1f4-5b5a9c6cb134 req-e619fcbb-8fb2-451d-944f-2fc4ebb6c5cb service nova] Creating event network-changed:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:51:18 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-7046207a-fa65-42ae-a1f4-5b5a9c6cb134 req-e619fcbb-8fb2-451d-944f-2fc4ebb6c5cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038182 Apr 14 10:51:18 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 163/479] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:18 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-eedbe14c-300e-426c-a3ae-98164f9101f3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d064a60>, body: {"keypair": {"name": "tempest-keypair-388083155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeYGYiTcJWVdyGLLXUUtNmeqpPAuLbYzcQtlw/K/cx7u5I+/z+BFqZ/Q85m4vszeUjxdAJi787/sHm5PWAgol4M4ijgjZBMAK6LdEVj2SxKBuOkTED+u+J8G5CKwgGGjA=="}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:18 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-eedbe14c-300e-426c-a3ae-98164f9101f3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for project cb8f294f957f4c74ae959c1e9f238427. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:51:18 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-eedbe14c-300e-426c-a3ae-98164f9101f3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for user 78adbbdcd10e446daddde754e46309b2 and project cb8f294f957f4c74ae959c1e9f238427. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:51:18 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-eedbe14c-300e-426c-a3ae-98164f9101f3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.156330 Apr 14 10:51:18 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 158/480] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 10:51:18 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:20 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:20 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-6623a330-cd93-493b-925a-ab7200b9d902 req-c8c0cbf0-ca57-4bad-b37e-58841c6f26c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "name": "network-vif-plugged", "status": "completed", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:20 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-917305574", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b639a68a-2b4e-435c-b98b-65b5b4981c73"}], "security_groups": [{"name": "tempest-securitygroup--689492262"}], "key_name": "tempest-keypair-388083155", "user_data": "}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6623a330-cd93-493b-925a-ab7200b9d902 req-c8c0cbf0-ca57-4bad-b37e-58841c6f26c9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6623a330-cd93-493b-925a-ab7200b9d902 req-c8c0cbf0-ca57-4bad-b37e-58841c6f26c9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6623a330-cd93-493b-925a-ab7200b9d902 req-c8c0cbf0-ca57-4bad-b37e-58841c6f26c9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:20 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-6623a330-cd93-493b-925a-ab7200b9d902 req-c8c0cbf0-ca57-4bad-b37e-58841c6f26c9 service nova] Creating event network-vif-plugged:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:51:20 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Going to try to start instance {{(pid=61840) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 10:51:20 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-6623a330-cd93-493b-925a-ab7200b9d902 req-c8c0cbf0-ca57-4bad-b37e-58841c6f26c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052988 Apr 14 10:51:20 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 164/481] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:20 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/action" status: 202 len: 0 microversion: 2.1 time: 0.204579 Apr 14 10:51:20 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 160/482] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:51:20 2023] POST /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:51:20 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-333b4a21-caa2-4259-9edb-9f23591552c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:20 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-333b4a21-caa2-4259-9edb-9f23591552c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-333b4a21-caa2-4259-9edb-9f23591552c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-333b4a21-caa2-4259-9edb-9f23591552c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-333b4a21-caa2-4259-9edb-9f23591552c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-333b4a21-caa2-4259-9edb-9f23591552c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-333b4a21-caa2-4259-9edb-9f23591552c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-333b4a21-caa2-4259-9edb-9f23591552c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:20 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] validate_networks() for [('b639a68a-2b4e-435c-b98b-65b5b4981c73', None, None, None, None, None)] {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:51:20 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-333b4a21-caa2-4259-9edb-9f23591552c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:51:20 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-333b4a21-caa2-4259-9edb-9f23591552c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871" status: 200 len: 1696 microversion: 2.1 time: 0.301523 Apr 14 10:51:20 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 165/483] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:51:20 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 => generated 1696 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 10:51:21 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:51:21 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:51:21 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:51:21 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:51:21 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:51:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:21 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for project cb8f294f957f4c74ae959c1e9f238427. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:51:21 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for user 78adbbdcd10e446daddde754e46309b2 and project cb8f294f957f4c74ae959c1e9f238427. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:51:21 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:51:21 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:51:21 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.680458 Apr 14 10:51:21 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 159/484] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:51:20 2023] POST /compute/v2.1/servers => generated 399 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 14 10:51:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-38803af6-3998-4e6d-9dcb-499e157104d8 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:21 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-38803af6-3998-4e6d-9dcb-499e157104d8 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:21 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-38803af6-3998-4e6d-9dcb-499e157104d8 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:51:21 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-38803af6-3998-4e6d-9dcb-499e157104d8 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb" status: 200 len: 1234 microversion: 2.1 time: 0.082316 Apr 14 10:51:21 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 161/485] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:51:21 2023] GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb => generated 1234 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:51:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-d1bee4ff-8b79-43a2-801e-197208daa3b6 req-7f4092b7-6ad9-45bd-85f5-bb7a9a8f18fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "name": "network-vif-plugged", "status": "completed", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:22 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=12 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-d1bee4ff-8b79-43a2-801e-197208daa3b6 req-7f4092b7-6ad9-45bd-85f5-bb7a9a8f18fd service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-d1bee4ff-8b79-43a2-801e-197208daa3b6 req-7f4092b7-6ad9-45bd-85f5-bb7a9a8f18fd service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-d1bee4ff-8b79-43a2-801e-197208daa3b6 req-7f4092b7-6ad9-45bd-85f5-bb7a9a8f18fd service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:22 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-d1bee4ff-8b79-43a2-801e-197208daa3b6 req-7f4092b7-6ad9-45bd-85f5-bb7a9a8f18fd service nova] Creating event network-vif-plugged:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:51:22 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-d1bee4ff-8b79-43a2-801e-197208daa3b6 req-7f4092b7-6ad9-45bd-85f5-bb7a9a8f18fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046808 Apr 14 10:51:22 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 166/486] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:24 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-ea2c5c21-784b-479b-8dc5-e9cde9ca15e6 req-c7d32161-e00a-4aaa-a667-c0f1305d6a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd661ae0-c4bb-4117-847d-ef7e85d062fb", "tag": "e2fa8ebc-482c-460c-924a-26111123a1d5"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-ea2c5c21-784b-479b-8dc5-e9cde9ca15e6 req-c7d32161-e00a-4aaa-a667-c0f1305d6a7e service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-ea2c5c21-784b-479b-8dc5-e9cde9ca15e6 req-c7d32161-e00a-4aaa-a667-c0f1305d6a7e service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-ea2c5c21-784b-479b-8dc5-e9cde9ca15e6 req-c7d32161-e00a-4aaa-a667-c0f1305d6a7e service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:24 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-ea2c5c21-784b-479b-8dc5-e9cde9ca15e6 req-c7d32161-e00a-4aaa-a667-c0f1305d6a7e service nova] Creating event network-changed:e2fa8ebc-482c-460c-924a-26111123a1d5 for instance cd661ae0-c4bb-4117-847d-ef7e85d062fb on user Apr 14 10:51:24 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-ea2c5c21-784b-479b-8dc5-e9cde9ca15e6 req-c7d32161-e00a-4aaa-a667-c0f1305d6a7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039695 Apr 14 10:51:24 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 160/487] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:27 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-846a3770-8152-4cc4-81f5-36d178677a51 req-5a319a02-ca86-4454-9f91-1855829b09b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8586a70e-9855-4177-ac1b-cf707a4df871", "name": "network-vif-plugged", "status": "completed", "tag": "473d9af8-25a0-4e5a-9afb-7a0c843115cc"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:27 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-846a3770-8152-4cc4-81f5-36d178677a51 req-5a319a02-ca86-4454-9f91-1855829b09b3 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:27 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-846a3770-8152-4cc4-81f5-36d178677a51 req-5a319a02-ca86-4454-9f91-1855829b09b3 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:27 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-846a3770-8152-4cc4-81f5-36d178677a51 req-5a319a02-ca86-4454-9f91-1855829b09b3 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:27 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-846a3770-8152-4cc4-81f5-36d178677a51 req-5a319a02-ca86-4454-9f91-1855829b09b3 service nova] Creating event network-vif-plugged:473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance 8586a70e-9855-4177-ac1b-cf707a4df871 on user Apr 14 10:51:27 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-846a3770-8152-4cc4-81f5-36d178677a51 req-5a319a02-ca86-4454-9f91-1855829b09b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028215 Apr 14 10:51:27 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 162/488] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:27 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-466755f8-47f6-4d0e-aa27-a4492699e9a7 req-7aad4602-8d15-4647-b46d-098abc9ba20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd661ae0-c4bb-4117-847d-ef7e85d062fb", "name": "network-vif-plugged", "status": "completed", "tag": "e2fa8ebc-482c-460c-924a-26111123a1d5"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-466755f8-47f6-4d0e-aa27-a4492699e9a7 req-7aad4602-8d15-4647-b46d-098abc9ba20d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-466755f8-47f6-4d0e-aa27-a4492699e9a7 req-7aad4602-8d15-4647-b46d-098abc9ba20d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-466755f8-47f6-4d0e-aa27-a4492699e9a7 req-7aad4602-8d15-4647-b46d-098abc9ba20d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:27 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-466755f8-47f6-4d0e-aa27-a4492699e9a7 req-7aad4602-8d15-4647-b46d-098abc9ba20d service nova] Creating event network-vif-plugged:e2fa8ebc-482c-460c-924a-26111123a1d5 for instance cd661ae0-c4bb-4117-847d-ef7e85d062fb on user Apr 14 10:51:27 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-466755f8-47f6-4d0e-aa27-a4492699e9a7 req-7aad4602-8d15-4647-b46d-098abc9ba20d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045696 Apr 14 10:51:27 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 167/489] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:29 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-9d869a3e-d213-4af1-bd18-699a247f7664 req-0ee773bf-6407-4e05-8805-8dbd72870435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8586a70e-9855-4177-ac1b-cf707a4df871", "name": "network-vif-plugged", "status": "completed", "tag": "473d9af8-25a0-4e5a-9afb-7a0c843115cc"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9d869a3e-d213-4af1-bd18-699a247f7664 req-0ee773bf-6407-4e05-8805-8dbd72870435 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9d869a3e-d213-4af1-bd18-699a247f7664 req-0ee773bf-6407-4e05-8805-8dbd72870435 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9d869a3e-d213-4af1-bd18-699a247f7664 req-0ee773bf-6407-4e05-8805-8dbd72870435 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:29 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-9d869a3e-d213-4af1-bd18-699a247f7664 req-0ee773bf-6407-4e05-8805-8dbd72870435 service nova] Creating event network-vif-plugged:473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance 8586a70e-9855-4177-ac1b-cf707a4df871 on user Apr 14 10:51:29 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-9d869a3e-d213-4af1-bd18-699a247f7664 req-0ee773bf-6407-4e05-8805-8dbd72870435 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028228 Apr 14 10:51:29 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 161/490] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:29 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-8f320317-eca9-4e06-98ba-571e9498a673 req-6aa1e786-321d-492a-8c62-7d3560bc3ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd661ae0-c4bb-4117-847d-ef7e85d062fb", "name": "network-vif-plugged", "status": "completed", "tag": "e2fa8ebc-482c-460c-924a-26111123a1d5"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8f320317-eca9-4e06-98ba-571e9498a673 req-6aa1e786-321d-492a-8c62-7d3560bc3ee1 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8f320317-eca9-4e06-98ba-571e9498a673 req-6aa1e786-321d-492a-8c62-7d3560bc3ee1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8f320317-eca9-4e06-98ba-571e9498a673 req-6aa1e786-321d-492a-8c62-7d3560bc3ee1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-8f320317-eca9-4e06-98ba-571e9498a673 req-6aa1e786-321d-492a-8c62-7d3560bc3ee1 service nova] Creating event network-vif-plugged:e2fa8ebc-482c-460c-924a-26111123a1d5 for instance cd661ae0-c4bb-4117-847d-ef7e85d062fb on user Apr 14 10:51:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-8f320317-eca9-4e06-98ba-571e9498a673 req-6aa1e786-321d-492a-8c62-7d3560bc3ee1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028216 Apr 14 10:51:29 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 163/491] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-f2fadf62-3471-4ec7-b658-e3cfeccff965 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:32 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-f2fadf62-3471-4ec7-b658-e3cfeccff965 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:32 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f2fadf62-3471-4ec7-b658-e3cfeccff965 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f2fadf62-3471-4ec7-b658-e3cfeccff965 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f2fadf62-3471-4ec7-b658-e3cfeccff965 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f2fadf62-3471-4ec7-b658-e3cfeccff965 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f2fadf62-3471-4ec7-b658-e3cfeccff965 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f2fadf62-3471-4ec7-b658-e3cfeccff965 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:32 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=23 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:32 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-f2fadf62-3471-4ec7-b658-e3cfeccff965 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:51:33 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-f2fadf62-3471-4ec7-b658-e3cfeccff965 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1676 microversion: 2.1 time: 0.225036 Apr 14 10:51:33 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 168/492] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:51:32 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:51:33 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:33 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=18 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:33 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:33 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:33 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334580 Apr 14 10:51:33 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 162/493] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:51:33 2023] POST /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:34 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:34 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ae8fed9d-9f29-4990-a582-27deb2b0bccf tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:34 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-ae8fed9d-9f29-4990-a582-27deb2b0bccf tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:34 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae8fed9d-9f29-4990-a582-27deb2b0bccf tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae8fed9d-9f29-4990-a582-27deb2b0bccf tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae8fed9d-9f29-4990-a582-27deb2b0bccf tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae8fed9d-9f29-4990-a582-27deb2b0bccf tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae8fed9d-9f29-4990-a582-27deb2b0bccf tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae8fed9d-9f29-4990-a582-27deb2b0bccf tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:34 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-ae8fed9d-9f29-4990-a582-27deb2b0bccf tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/os-volume_attachments/e6828770-fda7-4cd5-b857-c4d2599299a7" status: 200 len: 194 microversion: 2.20 time: 0.286307 Apr 14 10:51:34 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 164/494] 10.0.0.210 () {64 vars in 1531 bytes} [Fri Apr 14 10:51:34 2023] GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/os-volume_attachments/e6828770-fda7-4cd5-b857-c4d2599299a7 => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:51:34 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:34 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:35 user devstack@n-api.service[61841]: DEBUG nova.objects.instance [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'services' on Instance uuid 4b767f1b-e97e-497c-8c70-8806203c76ae {{(pid=61841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:51:35 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/os-volume_attachments/e6828770-fda7-4cd5-b857-c4d2599299a7" status: 202 len: 0 microversion: 2.20 time: 0.305344 Apr 14 10:51:35 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 169/495] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 10:51:34 2023] DELETE /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/os-volume_attachments/e6828770-fda7-4cd5-b857-c4d2599299a7 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:51:35 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-94b7c09c-7b60-4997-afb8-4ccd7a05813a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:35 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-94b7c09c-7b60-4997-afb8-4ccd7a05813a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:35 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=7 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-94b7c09c-7b60-4997-afb8-4ccd7a05813a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-94b7c09c-7b60-4997-afb8-4ccd7a05813a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-94b7c09c-7b60-4997-afb8-4ccd7a05813a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-94b7c09c-7b60-4997-afb8-4ccd7a05813a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-94b7c09c-7b60-4997-afb8-4ccd7a05813a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-94b7c09c-7b60-4997-afb8-4ccd7a05813a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:35 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:35 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-94b7c09c-7b60-4997-afb8-4ccd7a05813a tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095263 Apr 14 10:51:35 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 163/496] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 10:51:35 2023] GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 10:51:37 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-6f4d5a01-a3fa-43ae-8dbc-9fd783eb30d9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:37 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-6f4d5a01-a3fa-43ae-8dbc-9fd783eb30d9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:37 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6f4d5a01-a3fa-43ae-8dbc-9fd783eb30d9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:37 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6f4d5a01-a3fa-43ae-8dbc-9fd783eb30d9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:37 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6f4d5a01-a3fa-43ae-8dbc-9fd783eb30d9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:37 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6f4d5a01-a3fa-43ae-8dbc-9fd783eb30d9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:37 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6f4d5a01-a3fa-43ae-8dbc-9fd783eb30d9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:37 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6f4d5a01-a3fa-43ae-8dbc-9fd783eb30d9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:37 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-6f4d5a01-a3fa-43ae-8dbc-9fd783eb30d9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] HTTP exception thrown: Instance 55178126-9766-4875-9122-39dcc87ce82c could not be found. Apr 14 10:51:37 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-6f4d5a01-a3fa-43ae-8dbc-9fd783eb30d9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Request method failure captured: Apr 14 10:51:37 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c HTTP/1.1 Apr 14 10:51:37 user devstack@n-api.service[61840]: Accept: application/json Apr 14 10:51:37 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 10:51:37 user devstack@n-api.service[61840]: Connection: close Apr 14 10:51:37 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 10:51:37 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 10:51:37 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 10:51:37 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 10:51:37 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 10:51:37 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS5os_adZ0w9HGgJ0ukzD40ooKsdj5BD60na4Acbe7Jt4sXPiZ0EydqcJmzufArpjeAwD6VSupyWhDJPQX5CIekEzI7SqaKGh8UGpoMoSPtKNXtjfADXAngSwbNdjxnc9zltxOWg3p-8hS0Uv932FTZuuup5d1PolVUrShvgqIX0LGU Apr 14 10:51:37 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 10:51:37 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 10:51:37 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 10:51:37 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 10:51:37 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 10:51:37 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 10:51:37 user devstack@n-api.service[61840]: X-Project-Id: 1696bf804b2e4d7f86162513015c8e52 Apr 14 10:51:37 user devstack@n-api.service[61840]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1747462102 Apr 14 10:51:37 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 10:51:37 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 10:51:37 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1696bf804b2e4d7f86162513015c8e52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1696bf804b2e4d7f86162513015c8e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1696bf804b2e4d7f86162513015c8e52"}]}] Apr 14 10:51:37 user devstack@n-api.service[61840]: X-Tenant: tempest-SnapshotDataIntegrityTests-1747462102 Apr 14 10:51:37 user devstack@n-api.service[61840]: X-Tenant-Id: 1696bf804b2e4d7f86162513015c8e52 Apr 14 10:51:37 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1747462102 Apr 14 10:51:37 user devstack@n-api.service[61840]: X-User: tempest-SnapshotDataIntegrityTests-1747462102-project-member Apr 14 10:51:37 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 10:51:37 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 10:51:37 user devstack@n-api.service[61840]: X-User-Id: 09ed4663d8984fe7b5d95616281bfbfc Apr 14 10:51:37 user devstack@n-api.service[61840]: X-User-Name: tempest-SnapshotDataIntegrityTests-1747462102-project-member Apr 14 10:51:37 user devstack@n-api.service[61840]: method: > Apr 14 10:51:37 user devstack@n-api.service[61840]: exception: Instance 55178126-9766-4875-9122-39dcc87ce82c could not be found. Apr 14 10:51:37 user devstack@n-api.service[61840]: action_args: {'id': '55178126-9766-4875-9122-39dcc87ce82c'} Apr 14 10:51:37 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55178126-9766-4875-9122-39dcc87ce82c could not be found. Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55178126-9766-4875-9122-39dcc87ce82c could not be found. Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55178126-9766-4875-9122-39dcc87ce82c could not be found. Apr 14 10:51:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:51:37 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-6f4d5a01-a3fa-43ae-8dbc-9fd783eb30d9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Returning 404 to user: Instance 55178126-9766-4875-9122-39dcc87ce82c could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:51:37 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-6f4d5a01-a3fa-43ae-8dbc-9fd783eb30d9 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c" status: 404 len: 111 microversion: 2.1 time: 0.050087 Apr 14 10:51:37 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 165/497] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:51:37 2023] GET /compute/v2.1/servers/55178126-9766-4875-9122-39dcc87ce82c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:51:37 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-64d54717-4ae8-44d7-bc25-db6b43fe1ed6 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Calling method '.version_select at 0x7fcd1d03d090>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:37 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-64d54717-4ae8-44d7-bc25-db6b43fe1ed6 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1664538954" status: 202 len: 0 microversion: 2.1 time: 0.026127 Apr 14 10:51:37 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 170/498] 10.0.0.210 () {62 vars in 1355 bytes} [Fri Apr 14 10:51:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1664538954 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Old instance type m1.nano, new instance type m1.micro {{(pid=61839) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting quotas for project 3ea2cb4dfa5b4a52b658efd8f5aefb36. Resources: {'cores', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting quotas for user 5873a358bf544691b12cd2979f5e36dc and project 3ea2cb4dfa5b4a52b658efd8f5aefb36. Resources: {'cores', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:51:41 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:51:41 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/action" status: 202 len: 0 microversion: 2.1 time: 0.302449 Apr 14 10:51:41 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 164/499] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:51:41 2023] POST /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:51:41 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-c30ed4cb-1d7a-470f-871b-3d7bf95200d7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:41 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-c30ed4cb-1d7a-470f-871b-3d7bf95200d7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c30ed4cb-1d7a-470f-871b-3d7bf95200d7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c30ed4cb-1d7a-470f-871b-3d7bf95200d7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c30ed4cb-1d7a-470f-871b-3d7bf95200d7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c30ed4cb-1d7a-470f-871b-3d7bf95200d7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c30ed4cb-1d7a-470f-871b-3d7bf95200d7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c30ed4cb-1d7a-470f-871b-3d7bf95200d7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:41 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-c30ed4cb-1d7a-470f-871b-3d7bf95200d7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:51:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-c30ed4cb-1d7a-470f-871b-3d7bf95200d7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1731 microversion: 2.1 time: 0.188396 Apr 14 10:51:41 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 166/500] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:51:41 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:51:44 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-f2d8e897-76b4-4360-a934-8aca33616c1b req-78084dc2-deb5-4130-83d3-00aa87d21cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-unplugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-f2d8e897-76b4-4360-a934-8aca33616c1b req-78084dc2-deb5-4130-83d3-00aa87d21cd9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-f2d8e897-76b4-4360-a934-8aca33616c1b req-78084dc2-deb5-4130-83d3-00aa87d21cd9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-f2d8e897-76b4-4360-a934-8aca33616c1b req-78084dc2-deb5-4130-83d3-00aa87d21cd9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:44 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-f2d8e897-76b4-4360-a934-8aca33616c1b req-78084dc2-deb5-4130-83d3-00aa87d21cd9 service nova] Creating event network-vif-unplugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:51:44 user devstack@n-api.service[61841]: DEBUG nova.compute.api [req-f2d8e897-76b4-4360-a934-8aca33616c1b req-78084dc2-deb5-4130-83d3-00aa87d21cd9 service nova] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61841) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 10:51:44 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-f2d8e897-76b4-4360-a934-8aca33616c1b req-78084dc2-deb5-4130-83d3-00aa87d21cd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087876 Apr 14 10:51:44 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 171/501] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:46 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-30f8addf-43d4-47d1-a61c-c714d90a74da req-6814dd18-77b3-4915-9ac7-a539d7a54bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-plugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-30f8addf-43d4-47d1-a61c-c714d90a74da req-6814dd18-77b3-4915-9ac7-a539d7a54bf4 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-30f8addf-43d4-47d1-a61c-c714d90a74da req-6814dd18-77b3-4915-9ac7-a539d7a54bf4 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-30f8addf-43d4-47d1-a61c-c714d90a74da req-6814dd18-77b3-4915-9ac7-a539d7a54bf4 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-30f8addf-43d4-47d1-a61c-c714d90a74da req-6814dd18-77b3-4915-9ac7-a539d7a54bf4 service nova] Creating event network-vif-plugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:51:46 user devstack@n-api.service[61839]: DEBUG nova.compute.api [req-30f8addf-43d4-47d1-a61c-c714d90a74da req-6814dd18-77b3-4915-9ac7-a539d7a54bf4 service nova] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61839) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 10:51:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-30f8addf-43d4-47d1-a61c-c714d90a74da req-6814dd18-77b3-4915-9ac7-a539d7a54bf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046142 Apr 14 10:51:46 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 165/502] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:51 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=5 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:51 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=13 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:51 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-cdd68dc9-019a-4595-98c0-dd121b63bbd9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:51 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-cdd68dc9-019a-4595-98c0-dd121b63bbd9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cdd68dc9-019a-4595-98c0-dd121b63bbd9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cdd68dc9-019a-4595-98c0-dd121b63bbd9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cdd68dc9-019a-4595-98c0-dd121b63bbd9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cdd68dc9-019a-4595-98c0-dd121b63bbd9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cdd68dc9-019a-4595-98c0-dd121b63bbd9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cdd68dc9-019a-4595-98c0-dd121b63bbd9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:52 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-cdd68dc9-019a-4595-98c0-dd121b63bbd9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac498c56dae543cf9e64fbb61ad50df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84a2fac4604454982dc018b36440b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:51:52 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-cdd68dc9-019a-4595-98c0-dd121b63bbd9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" status: 200 len: 1497 microversion: 2.1 time: 0.189185 Apr 14 10:51:52 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 167/503] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:51:51 2023] GET /compute/v2.1/servers/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:51:55 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:55 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:55 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e0b3dcd0-614a-4cdd-84fe-fbf2c85b39ba tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:51:55 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-e0b3dcd0-614a-4cdd-84fe-fbf2c85b39ba tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:51:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e0b3dcd0-614a-4cdd-84fe-fbf2c85b39ba tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e0b3dcd0-614a-4cdd-84fe-fbf2c85b39ba tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e0b3dcd0-614a-4cdd-84fe-fbf2c85b39ba tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e0b3dcd0-614a-4cdd-84fe-fbf2c85b39ba tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e0b3dcd0-614a-4cdd-84fe-fbf2c85b39ba tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e0b3dcd0-614a-4cdd-84fe-fbf2c85b39ba tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:55 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-e0b3dcd0-614a-4cdd-84fe-fbf2c85b39ba tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6adefa90332c42c79a1372258a7be5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca26975e5ad4524b4b1b1ec4335802f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:51:55 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-e0b3dcd0-614a-4cdd-84fe-fbf2c85b39ba tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" status: 200 len: 1495 microversion: 2.1 time: 0.154677 Apr 14 10:51:55 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 172/504] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:51:55 2023] GET /compute/v2.1/servers/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 => generated 1495 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:51:56 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=3 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:51:56 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-4c8ca1c4-ae59-4c24-ab40-5457e56286e3 req-ff793781-3bd7-4d41-9635-88c103b336ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-plugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4c8ca1c4-ae59-4c24-ab40-5457e56286e3 req-ff793781-3bd7-4d41-9635-88c103b336ef service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4c8ca1c4-ae59-4c24-ab40-5457e56286e3 req-ff793781-3bd7-4d41-9635-88c103b336ef service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4c8ca1c4-ae59-4c24-ab40-5457e56286e3 req-ff793781-3bd7-4d41-9635-88c103b336ef service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:56 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-4c8ca1c4-ae59-4c24-ab40-5457e56286e3 req-ff793781-3bd7-4d41-9635-88c103b336ef service nova] Creating event network-vif-plugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:51:56 user devstack@n-api.service[61839]: DEBUG nova.compute.api [req-4c8ca1c4-ae59-4c24-ab40-5457e56286e3 req-ff793781-3bd7-4d41-9635-88c103b336ef service nova] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61839) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 10:51:56 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-4c8ca1c4-ae59-4c24-ab40-5457e56286e3 req-ff793781-3bd7-4d41-9635-88c103b336ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047887 Apr 14 10:51:56 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 166/505] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:51:58 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-f51498dd-cba4-43bb-b280-deda47f0df4d req-8a368676-3395-4524-83ab-3974ab8f3652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-plugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:51:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f51498dd-cba4-43bb-b280-deda47f0df4d req-8a368676-3395-4524-83ab-3974ab8f3652 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:51:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f51498dd-cba4-43bb-b280-deda47f0df4d req-8a368676-3395-4524-83ab-3974ab8f3652 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:51:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f51498dd-cba4-43bb-b280-deda47f0df4d req-8a368676-3395-4524-83ab-3974ab8f3652 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:51:58 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-f51498dd-cba4-43bb-b280-deda47f0df4d req-8a368676-3395-4524-83ab-3974ab8f3652 service nova] Creating event network-vif-plugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:51:58 user devstack@n-api.service[61840]: DEBUG nova.compute.api [req-f51498dd-cba4-43bb-b280-deda47f0df4d req-8a368676-3395-4524-83ab-3974ab8f3652 service nova] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61840) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 10:51:58 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-f51498dd-cba4-43bb-b280-deda47f0df4d req-8a368676-3395-4524-83ab-3974ab8f3652 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048592 Apr 14 10:51:58 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 168/506] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:51:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:52:04 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-88f8339e-2ac0-40b8-adc5-91528e4a2bab tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:52:04 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-88f8339e-2ac0-40b8-adc5-91528e4a2bab tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:52:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-88f8339e-2ac0-40b8-adc5-91528e4a2bab tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-88f8339e-2ac0-40b8-adc5-91528e4a2bab tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-88f8339e-2ac0-40b8-adc5-91528e4a2bab tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-88f8339e-2ac0-40b8-adc5-91528e4a2bab tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-88f8339e-2ac0-40b8-adc5-91528e4a2bab tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-88f8339e-2ac0-40b8-adc5-91528e4a2bab tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:04 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-88f8339e-2ac0-40b8-adc5-91528e4a2bab tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:52:04 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-88f8339e-2ac0-40b8-adc5-91528e4a2bab tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" status: 200 len: 1553 microversion: 2.1 time: 0.195867 Apr 14 10:52:04 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 173/507] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:52:04 2023] GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => generated 1553 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:52:08 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=19 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:52:08 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:52:08 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "92413760-9bf6-4794-85ee-4450e5351a44"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:52:08 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:52:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:08 user devstack@n-api.service[61839]: DEBUG nova.objects.instance [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'flavor' on Instance uuid 6cae9f61-763f-4671-a873-d15f01384416 {{(pid=61839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:52:09 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416/action" status: 200 len: 29 microversion: 2.87 time: 0.593336 Apr 14 10:52:09 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 167/508] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 10:52:08 2023] POST /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416/action => generated 29 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 10:52:09 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:52:09 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=10 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:52:09 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-a4f478e6-2c62-4654-8e53-ee9a312e5b59 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:52:09 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-a4f478e6-2c62-4654-8e53-ee9a312e5b59 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:52:09 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a4f478e6-2c62-4654-8e53-ee9a312e5b59 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:09 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a4f478e6-2c62-4654-8e53-ee9a312e5b59 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:09 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a4f478e6-2c62-4654-8e53-ee9a312e5b59 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:09 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a4f478e6-2c62-4654-8e53-ee9a312e5b59 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:09 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a4f478e6-2c62-4654-8e53-ee9a312e5b59 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:09 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a4f478e6-2c62-4654-8e53-ee9a312e5b59 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:09 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-a4f478e6-2c62-4654-8e53-ee9a312e5b59 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:52:09 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-a4f478e6-2c62-4654-8e53-ee9a312e5b59 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:52:09 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-a4f478e6-2c62-4654-8e53-ee9a312e5b59 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:52:09 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-a4f478e6-2c62-4654-8e53-ee9a312e5b59 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416" status: 200 len: 1775 microversion: 2.87 time: 0.269614 Apr 14 10:52:09 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 169/509] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:52:09 2023] GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416 => generated 1775 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:52:10 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-1d1fea35-06ab-47e3-9958-a08db2875154 req-95a48dac-1808-43d6-a163-6a5ac8c8df50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cae9f61-763f-4671-a873-d15f01384416", "name": "network-vif-unplugged", "status": "completed", "tag": "30d57100-3321-41fe-9335-d53c8c5e291c"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:52:10 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-1d1fea35-06ab-47e3-9958-a08db2875154 req-95a48dac-1808-43d6-a163-6a5ac8c8df50 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:10 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-1d1fea35-06ab-47e3-9958-a08db2875154 req-95a48dac-1808-43d6-a163-6a5ac8c8df50 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:10 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-1d1fea35-06ab-47e3-9958-a08db2875154 req-95a48dac-1808-43d6-a163-6a5ac8c8df50 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:10 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-1d1fea35-06ab-47e3-9958-a08db2875154 req-95a48dac-1808-43d6-a163-6a5ac8c8df50 service nova] Creating event network-vif-unplugged:30d57100-3321-41fe-9335-d53c8c5e291c for instance 6cae9f61-763f-4671-a873-d15f01384416 on user Apr 14 10:52:10 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-1d1fea35-06ab-47e3-9958-a08db2875154 req-95a48dac-1808-43d6-a163-6a5ac8c8df50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039303 Apr 14 10:52:10 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 174/510] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:52:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:52:10 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-22479671-0a42-4518-8b82-7862308ae468 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:52:10 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-22479671-0a42-4518-8b82-7862308ae468 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:52:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-22479671-0a42-4518-8b82-7862308ae468 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-22479671-0a42-4518-8b82-7862308ae468 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-22479671-0a42-4518-8b82-7862308ae468 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-22479671-0a42-4518-8b82-7862308ae468 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-22479671-0a42-4518-8b82-7862308ae468 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-22479671-0a42-4518-8b82-7862308ae468 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:11 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-22479671-0a42-4518-8b82-7862308ae468 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:52:11 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-22479671-0a42-4518-8b82-7862308ae468 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871" status: 200 len: 1700 microversion: 2.1 time: 0.207527 Apr 14 10:52:11 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 168/511] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:52:10 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 => generated 1700 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:52:11 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-a707d02a-a95a-4e5f-ac9b-11d813b5be7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:52:11 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-a707d02a-a95a-4e5f-ac9b-11d813b5be7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:52:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a707d02a-a95a-4e5f-ac9b-11d813b5be7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a707d02a-a95a-4e5f-ac9b-11d813b5be7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a707d02a-a95a-4e5f-ac9b-11d813b5be7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a707d02a-a95a-4e5f-ac9b-11d813b5be7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a707d02a-a95a-4e5f-ac9b-11d813b5be7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a707d02a-a95a-4e5f-ac9b-11d813b5be7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:11 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-a707d02a-a95a-4e5f-ac9b-11d813b5be7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:52:11 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-a707d02a-a95a-4e5f-ac9b-11d813b5be7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb" status: 200 len: 1543 microversion: 2.1 time: 0.182415 Apr 14 10:52:11 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 170/512] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:52:11 2023] GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb => generated 1543 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:52:12 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-dd9d2ae6-6ada-407e-b921-328a99f93726 req-dc0b95f9-b099-4465-b589-1fc20234ecbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cae9f61-763f-4671-a873-d15f01384416", "name": "network-vif-plugged", "status": "completed", "tag": "30d57100-3321-41fe-9335-d53c8c5e291c"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:52:12 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-dd9d2ae6-6ada-407e-b921-328a99f93726 req-dc0b95f9-b099-4465-b589-1fc20234ecbf service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:12 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-dd9d2ae6-6ada-407e-b921-328a99f93726 req-dc0b95f9-b099-4465-b589-1fc20234ecbf service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:12 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-dd9d2ae6-6ada-407e-b921-328a99f93726 req-dc0b95f9-b099-4465-b589-1fc20234ecbf service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:12 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-dd9d2ae6-6ada-407e-b921-328a99f93726 req-dc0b95f9-b099-4465-b589-1fc20234ecbf service nova] Creating event network-vif-plugged:30d57100-3321-41fe-9335-d53c8c5e291c for instance 6cae9f61-763f-4671-a873-d15f01384416 on user Apr 14 10:52:12 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-dd9d2ae6-6ada-407e-b921-328a99f93726 req-dc0b95f9-b099-4465-b589-1fc20234ecbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059027 Apr 14 10:52:12 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 175/513] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:52:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:52:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-9d82f10f-b3cd-4f1e-aa1a-724deeefcaf7 req-80232b9a-cb77-49a6-a104-f64ff6909904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cae9f61-763f-4671-a873-d15f01384416", "name": "network-vif-plugged", "status": "completed", "tag": "30d57100-3321-41fe-9335-d53c8c5e291c"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:52:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9d82f10f-b3cd-4f1e-aa1a-724deeefcaf7 req-80232b9a-cb77-49a6-a104-f64ff6909904 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9d82f10f-b3cd-4f1e-aa1a-724deeefcaf7 req-80232b9a-cb77-49a6-a104-f64ff6909904 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9d82f10f-b3cd-4f1e-aa1a-724deeefcaf7 req-80232b9a-cb77-49a6-a104-f64ff6909904 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-9d82f10f-b3cd-4f1e-aa1a-724deeefcaf7 req-80232b9a-cb77-49a6-a104-f64ff6909904 service nova] Creating event network-vif-plugged:30d57100-3321-41fe-9335-d53c8c5e291c for instance 6cae9f61-763f-4671-a873-d15f01384416 on user Apr 14 10:52:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-9d82f10f-b3cd-4f1e-aa1a-724deeefcaf7 req-80232b9a-cb77-49a6-a104-f64ff6909904 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031252 Apr 14 10:52:14 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 169/514] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:52:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:52:16 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-a01497ec-8031-40a9-b30a-81d162723f61 req-8fb6633b-9ea6-48ae-89db-a23756b12e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cae9f61-763f-4671-a873-d15f01384416", "name": "network-vif-plugged", "status": "completed", "tag": "30d57100-3321-41fe-9335-d53c8c5e291c"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:52:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-a01497ec-8031-40a9-b30a-81d162723f61 req-8fb6633b-9ea6-48ae-89db-a23756b12e7c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-a01497ec-8031-40a9-b30a-81d162723f61 req-8fb6633b-9ea6-48ae-89db-a23756b12e7c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-a01497ec-8031-40a9-b30a-81d162723f61 req-8fb6633b-9ea6-48ae-89db-a23756b12e7c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-a01497ec-8031-40a9-b30a-81d162723f61 req-8fb6633b-9ea6-48ae-89db-a23756b12e7c service nova] Creating event network-vif-plugged:30d57100-3321-41fe-9335-d53c8c5e291c for instance 6cae9f61-763f-4671-a873-d15f01384416 on user Apr 14 10:52:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-a01497ec-8031-40a9-b30a-81d162723f61 req-8fb6633b-9ea6-48ae-89db-a23756b12e7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038000 Apr 14 10:52:16 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 171/515] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:52:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:52:25 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=8 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:52:25 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=16 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:52:25 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-58ceb895-bff6-4009-8ba0-80af5569054e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:52:25 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-58ceb895-bff6-4009-8ba0-80af5569054e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:52:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-58ceb895-bff6-4009-8ba0-80af5569054e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-58ceb895-bff6-4009-8ba0-80af5569054e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-58ceb895-bff6-4009-8ba0-80af5569054e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-58ceb895-bff6-4009-8ba0-80af5569054e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-58ceb895-bff6-4009-8ba0-80af5569054e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-58ceb895-bff6-4009-8ba0-80af5569054e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:25 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-58ceb895-bff6-4009-8ba0-80af5569054e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062249 Apr 14 10:52:25 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 176/516] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 10:52:25 2023] GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:52:25 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:52:25 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:52:25 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:52:25 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:52:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:25 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:52:25 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae" status: 204 len: 0 microversion: 2.20 time: 0.148593 Apr 14 10:52:25 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 170/517] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 10:52:25 2023] DELETE /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 10:52:25 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-93c12be3-32a3-484a-9174-3db9c6643f7f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:52:25 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-93c12be3-32a3-484a-9174-3db9c6643f7f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:52:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-93c12be3-32a3-484a-9174-3db9c6643f7f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-93c12be3-32a3-484a-9174-3db9c6643f7f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-93c12be3-32a3-484a-9174-3db9c6643f7f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-93c12be3-32a3-484a-9174-3db9c6643f7f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-93c12be3-32a3-484a-9174-3db9c6643f7f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-93c12be3-32a3-484a-9174-3db9c6643f7f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:25 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-93c12be3-32a3-484a-9174-3db9c6643f7f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:52:25 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-93c12be3-32a3-484a-9174-3db9c6643f7f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:52:25 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-93c12be3-32a3-484a-9174-3db9c6643f7f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:52:25 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-93c12be3-32a3-484a-9174-3db9c6643f7f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae" status: 200 len: 1712 microversion: 2.20 time: 0.269794 Apr 14 10:52:25 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 172/518] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:52:25 2023] GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae => generated 1712 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:52:25 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-da591ad2-4c24-4681-9a70-29692a3ad004 req-44169b14-2507-4369-ac35-f5549a5ef7de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b767f1b-e97e-497c-8c70-8806203c76ae", "name": "network-vif-unplugged", "status": "completed", "tag": "8d8a356d-c198-4e13-a489-5c626fbd025c"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:52:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-da591ad2-4c24-4681-9a70-29692a3ad004 req-44169b14-2507-4369-ac35-f5549a5ef7de service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-da591ad2-4c24-4681-9a70-29692a3ad004 req-44169b14-2507-4369-ac35-f5549a5ef7de service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-da591ad2-4c24-4681-9a70-29692a3ad004 req-44169b14-2507-4369-ac35-f5549a5ef7de service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:25 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-da591ad2-4c24-4681-9a70-29692a3ad004 req-44169b14-2507-4369-ac35-f5549a5ef7de service nova] Creating event network-vif-unplugged:8d8a356d-c198-4e13-a489-5c626fbd025c for instance 4b767f1b-e97e-497c-8c70-8806203c76ae on user Apr 14 10:52:25 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-da591ad2-4c24-4681-9a70-29692a3ad004 req-44169b14-2507-4369-ac35-f5549a5ef7de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034949 Apr 14 10:52:25 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 177/519] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:52:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:52:27 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-683e4ff7-24c5-4613-8e3e-2da663c2df78 req-6bea44ff-1029-4abd-b614-86e7f21bc323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b767f1b-e97e-497c-8c70-8806203c76ae", "name": "network-vif-deleted", "tag": "8d8a356d-c198-4e13-a489-5c626fbd025c"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:52:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-683e4ff7-24c5-4613-8e3e-2da663c2df78 req-6bea44ff-1029-4abd-b614-86e7f21bc323 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-683e4ff7-24c5-4613-8e3e-2da663c2df78 req-6bea44ff-1029-4abd-b614-86e7f21bc323 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-683e4ff7-24c5-4613-8e3e-2da663c2df78 req-6bea44ff-1029-4abd-b614-86e7f21bc323 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:27 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-683e4ff7-24c5-4613-8e3e-2da663c2df78 req-6bea44ff-1029-4abd-b614-86e7f21bc323 service nova] Creating event network-vif-deleted:8d8a356d-c198-4e13-a489-5c626fbd025c for instance 4b767f1b-e97e-497c-8c70-8806203c76ae on user Apr 14 10:52:27 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-683e4ff7-24c5-4613-8e3e-2da663c2df78 req-6bea44ff-1029-4abd-b614-86e7f21bc323 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029780 Apr 14 10:52:27 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 171/520] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:52:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:52:27 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-a45eed83-3a3e-4ef2-8ba5-3f958d65712c req-0c6f0058-67f9-48b3-b7b7-3dee493ef0cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b767f1b-e97e-497c-8c70-8806203c76ae", "name": "network-vif-plugged", "status": "completed", "tag": "8d8a356d-c198-4e13-a489-5c626fbd025c"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:52:27 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-a45eed83-3a3e-4ef2-8ba5-3f958d65712c req-0c6f0058-67f9-48b3-b7b7-3dee493ef0cc service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:27 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-a45eed83-3a3e-4ef2-8ba5-3f958d65712c req-0c6f0058-67f9-48b3-b7b7-3dee493ef0cc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:27 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-a45eed83-3a3e-4ef2-8ba5-3f958d65712c req-0c6f0058-67f9-48b3-b7b7-3dee493ef0cc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:27 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-a45eed83-3a3e-4ef2-8ba5-3f958d65712c req-0c6f0058-67f9-48b3-b7b7-3dee493ef0cc service nova] Creating event network-vif-plugged:8d8a356d-c198-4e13-a489-5c626fbd025c for instance 4b767f1b-e97e-497c-8c70-8806203c76ae on user Apr 14 10:52:27 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-a45eed83-3a3e-4ef2-8ba5-3f958d65712c req-0c6f0058-67f9-48b3-b7b7-3dee493ef0cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031754 Apr 14 10:52:27 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 173/521] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:52:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:52:31 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-898d93f0-4ef3-4154-934f-087895c4ed22 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:52:31 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-898d93f0-4ef3-4154-934f-087895c4ed22 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:52:31 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-898d93f0-4ef3-4154-934f-087895c4ed22 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:31 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-898d93f0-4ef3-4154-934f-087895c4ed22 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:31 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-898d93f0-4ef3-4154-934f-087895c4ed22 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:31 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-898d93f0-4ef3-4154-934f-087895c4ed22 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:31 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-898d93f0-4ef3-4154-934f-087895c4ed22 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:31 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-898d93f0-4ef3-4154-934f-087895c4ed22 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:31 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-898d93f0-4ef3-4154-934f-087895c4ed22 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:52:31 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-898d93f0-4ef3-4154-934f-087895c4ed22 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1730 microversion: 2.1 time: 0.329898 Apr 14 10:52:31 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 178/522] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:52:31 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1730 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:52:52 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:52:52 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:52:52 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7941e1c1-c0c5-4459-9b3e-e09e2d755f77", "device": "/dev/vdb"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:52:52 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:52:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:52 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.591018 Apr 14 10:52:52 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 172/523] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:52:52 2023] POST /compute/v2.1/servers/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/os-volume_attachments => generated 194 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:52:59 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=12 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:52:59 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=22 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:52:59 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-738de19e-399d-4b7a-8c15-efb559f9fa5b tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8904bfc5-adef-43f2-a820-3e0be1f8b1b9"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:52:59 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-738de19e-399d-4b7a-8c15-efb559f9fa5b tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:52:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-738de19e-399d-4b7a-8c15-efb559f9fa5b tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-738de19e-399d-4b7a-8c15-efb559f9fa5b tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-738de19e-399d-4b7a-8c15-efb559f9fa5b tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-738de19e-399d-4b7a-8c15-efb559f9fa5b tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-738de19e-399d-4b7a-8c15-efb559f9fa5b tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-738de19e-399d-4b7a-8c15-efb559f9fa5b tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:59 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-738de19e-399d-4b7a-8c15-efb559f9fa5b tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] HTTP exception thrown: Volume f4552cdd-ee91-4e7d-b67c-b2ddaac3989d could not be found. Apr 14 10:52:59 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-738de19e-399d-4b7a-8c15-efb559f9fa5b tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Request method failure captured: Apr 14 10:52:59 user devstack@n-api.service[61840]: request: PUT /compute/v2.1/servers/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/os-volume_attachments/f4552cdd-ee91-4e7d-b67c-b2ddaac3989d HTTP/1.1 Apr 14 10:52:59 user devstack@n-api.service[61840]: Accept: application/json Apr 14 10:52:59 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 10:52:59 user devstack@n-api.service[61840]: Connection: close Apr 14 10:52:59 user devstack@n-api.service[61840]: Content-Length: 74 Apr 14 10:52:59 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 10:52:59 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 10:52:59 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 10:52:59 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 10:52:59 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS9pqMQEl-6gOWHM7Apv50bU7BjZ3SO-V9rON5jLvoD3DlwFfBOhNglqNp0P5i06Hf6CELbKJtmmLyeIDi-4QRyVINBLQjkF8bn-hrToXQppf8iMP8KYDqGmyFHYj3ugQgNJGPwxTjwG-ZGwK_RE9KyFO-ThlIkZFzUdXKrVbqoSOo4 Apr 14 10:52:59 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 10:52:59 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 10:52:59 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 10:52:59 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 10:52:59 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 10:52:59 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 10:52:59 user devstack@n-api.service[61840]: X-Project-Id: cfd720d22714450094bb4bb180830245 Apr 14 10:52:59 user devstack@n-api.service[61840]: X-Project-Name: tempest-VolumesAdminNegativeTest-1105748712 Apr 14 10:52:59 user devstack@n-api.service[61840]: X-Role: member,admin,reader Apr 14 10:52:59 user devstack@n-api.service[61840]: X-Roles: member,admin,reader Apr 14 10:52:59 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cfd720d22714450094bb4bb180830245"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cfd720d22714450094bb4bb180830245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cfd720d22714450094bb4bb180830245"}]}] Apr 14 10:52:59 user devstack@n-api.service[61840]: X-Tenant: tempest-VolumesAdminNegativeTest-1105748712 Apr 14 10:52:59 user devstack@n-api.service[61840]: X-Tenant-Id: cfd720d22714450094bb4bb180830245 Apr 14 10:52:59 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1105748712 Apr 14 10:52:59 user devstack@n-api.service[61840]: X-User: tempest-VolumesAdminNegativeTest-1105748712-project-admin Apr 14 10:52:59 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 10:52:59 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 10:52:59 user devstack@n-api.service[61840]: X-User-Id: 1b1e48eda4ea480a8a19bdd28338b6ce Apr 14 10:52:59 user devstack@n-api.service[61840]: X-User-Name: tempest-VolumesAdminNegativeTest-1105748712-project-admin Apr 14 10:52:59 user devstack@n-api.service[61840]: Apr 14 10:52:59 user devstack@n-api.service[61840]: {"volumeAttachment": {"volumeId": "8904bfc5-adef-43f2-a820-3e0be1f8b1b9"}} Apr 14 10:52:59 user devstack@n-api.service[61840]: method: > Apr 14 10:52:59 user devstack@n-api.service[61840]: exception: Volume f4552cdd-ee91-4e7d-b67c-b2ddaac3989d could not be found. Apr 14 10:52:59 user devstack@n-api.service[61840]: action_args: {'server_id': '3b4b6e3e-0743-4ee6-900c-3172b09eb0f2', 'id': 'f4552cdd-ee91-4e7d-b67c-b2ddaac3989d', 'body': {'volumeAttachment': {'volumeId': '8904bfc5-adef-43f2-a820-3e0be1f8b1b9'}}} Apr 14 10:52:59 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f4552cdd-ee91-4e7d-b67c-b2ddaac3989d could not be found. (HTTP 404) (Request-ID: req-69777735-d97b-4e66-87dc-69de363f8f86) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f4552cdd-ee91-4e7d-b67c-b2ddaac3989d could not be found. Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f4552cdd-ee91-4e7d-b67c-b2ddaac3989d could not be found. Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f4552cdd-ee91-4e7d-b67c-b2ddaac3989d could not be found. Apr 14 10:52:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:52:59 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-738de19e-399d-4b7a-8c15-efb559f9fa5b tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] Returning 404 to user: Volume f4552cdd-ee91-4e7d-b67c-b2ddaac3989d could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:52:59 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-738de19e-399d-4b7a-8c15-efb559f9fa5b tempest-VolumesAdminNegativeTest-1105748712 tempest-VolumesAdminNegativeTest-1105748712-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/os-volume_attachments/f4552cdd-ee91-4e7d-b67c-b2ddaac3989d" status: 404 len: 109 microversion: 2.1 time: 0.139651 Apr 14 10:52:59 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 174/524] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 10:52:59 2023] PUT /compute/v2.1/servers/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/os-volume_attachments/f4552cdd-ee91-4e7d-b67c-b2ddaac3989d => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:52:59 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9367f260-9d4c-4b81-9ab4-0f73b9e80e09 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:52:59 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-9367f260-9d4c-4b81-9ab4-0f73b9e80e09 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:52:59 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:52:59 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=14 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:52:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9367f260-9d4c-4b81-9ab4-0f73b9e80e09 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9367f260-9d4c-4b81-9ab4-0f73b9e80e09 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9367f260-9d4c-4b81-9ab4-0f73b9e80e09 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9367f260-9d4c-4b81-9ab4-0f73b9e80e09 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:52:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9367f260-9d4c-4b81-9ab4-0f73b9e80e09 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:52:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9367f260-9d4c-4b81-9ab4-0f73b9e80e09 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:52:59 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-9367f260-9d4c-4b81-9ab4-0f73b9e80e09 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:52:59 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-9367f260-9d4c-4b81-9ab4-0f73b9e80e09 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:52:59 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-9367f260-9d4c-4b81-9ab4-0f73b9e80e09 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:52:59 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-9367f260-9d4c-4b81-9ab4-0f73b9e80e09 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416" status: 200 len: 1755 microversion: 2.87 time: 0.183502 Apr 14 10:52:59 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 179/525] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:52:59 2023] GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:53:02 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:02 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:02 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:02 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:53:02 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" status: 204 len: 0 microversion: 2.1 time: 0.191551 Apr 14 10:53:02 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 173/526] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:53:02 2023] DELETE /compute/v2.1/servers/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:53:02 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-10afd78f-b640-4d0c-a103-5245ca641fd7 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:02 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-10afd78f-b640-4d0c-a103-5245ca641fd7 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-10afd78f-b640-4d0c-a103-5245ca641fd7 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-10afd78f-b640-4d0c-a103-5245ca641fd7 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-10afd78f-b640-4d0c-a103-5245ca641fd7 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-10afd78f-b640-4d0c-a103-5245ca641fd7 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-10afd78f-b640-4d0c-a103-5245ca641fd7 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-10afd78f-b640-4d0c-a103-5245ca641fd7 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:02 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-10afd78f-b640-4d0c-a103-5245ca641fd7 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6adefa90332c42c79a1372258a7be5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca26975e5ad4524b4b1b1ec4335802f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:53:02 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-10afd78f-b640-4d0c-a103-5245ca641fd7 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" status: 200 len: 1501 microversion: 2.1 time: 0.249967 Apr 14 10:53:02 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 175/527] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:53:02 2023] GET /compute/v2.1/servers/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 => generated 1501 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:53:03 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-7352be6d-4ce2-4000-abe3-26676378ddcb req-d18044aa-d786-43e7-958a-3cd07f6ed772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2", "name": "network-vif-unplugged", "status": "completed", "tag": "2f4949b3-11d4-4970-878c-49a35c428147"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7352be6d-4ce2-4000-abe3-26676378ddcb req-d18044aa-d786-43e7-958a-3cd07f6ed772 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7352be6d-4ce2-4000-abe3-26676378ddcb req-d18044aa-d786-43e7-958a-3cd07f6ed772 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7352be6d-4ce2-4000-abe3-26676378ddcb req-d18044aa-d786-43e7-958a-3cd07f6ed772 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:03 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-7352be6d-4ce2-4000-abe3-26676378ddcb req-d18044aa-d786-43e7-958a-3cd07f6ed772 service nova] Creating event network-vif-unplugged:2f4949b3-11d4-4970-878c-49a35c428147 for instance 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 on user Apr 14 10:53:03 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-7352be6d-4ce2-4000-abe3-26676378ddcb req-d18044aa-d786-43e7-958a-3cd07f6ed772 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092078 Apr 14 10:53:03 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 180/528] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:04 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-0f5afb9e-ebe4-416d-9bd1-d0004d746c99 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:04 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-0f5afb9e-ebe4-416d-9bd1-d0004d746c99 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0f5afb9e-ebe4-416d-9bd1-d0004d746c99 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0f5afb9e-ebe4-416d-9bd1-d0004d746c99 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0f5afb9e-ebe4-416d-9bd1-d0004d746c99 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0f5afb9e-ebe4-416d-9bd1-d0004d746c99 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0f5afb9e-ebe4-416d-9bd1-d0004d746c99 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0f5afb9e-ebe4-416d-9bd1-d0004d746c99 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:04 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-0f5afb9e-ebe4-416d-9bd1-d0004d746c99 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.125156 Apr 14 10:53:04 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 174/529] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 10:53:04 2023] GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/os-interface => generated 282 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:05 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-ea2abf3b-38cb-4c04-a189-d9ab9d1fd658 req-468c24ab-3a9c-442f-b117-c2c4a6342a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2", "name": "network-vif-plugged", "status": "completed", "tag": "2f4949b3-11d4-4970-878c-49a35c428147"}, {"server_uuid": "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2", "name": "network-vif-deleted", "tag": "2f4949b3-11d4-4970-878c-49a35c428147"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:05 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ea2abf3b-38cb-4c04-a189-d9ab9d1fd658 req-468c24ab-3a9c-442f-b117-c2c4a6342a4d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:05 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ea2abf3b-38cb-4c04-a189-d9ab9d1fd658 req-468c24ab-3a9c-442f-b117-c2c4a6342a4d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:05 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ea2abf3b-38cb-4c04-a189-d9ab9d1fd658 req-468c24ab-3a9c-442f-b117-c2c4a6342a4d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:05 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-ea2abf3b-38cb-4c04-a189-d9ab9d1fd658 req-468c24ab-3a9c-442f-b117-c2c4a6342a4d service nova] Creating event network-vif-plugged:2f4949b3-11d4-4970-878c-49a35c428147 for instance 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 on user Apr 14 10:53:05 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-ea2abf3b-38cb-4c04-a189-d9ab9d1fd658 req-468c24ab-3a9c-442f-b117-c2c4a6342a4d service nova] Creating event network-vif-deleted:2f4949b3-11d4-4970-878c-49a35c428147 for instance 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 on user Apr 14 10:53:05 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-ea2abf3b-38cb-4c04-a189-d9ab9d1fd658 req-468c24ab-3a9c-442f-b117-c2c4a6342a4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033602 Apr 14 10:53:05 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 176/530] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:05 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-dec2dd9e-2fc7-47ee-aa51-7898c3b5baf3 req-5731e8cf-ec79-4c30-be68-8d2ac2a56dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-dec2dd9e-2fc7-47ee-aa51-7898c3b5baf3 req-5731e8cf-ec79-4c30-be68-8d2ac2a56dc6 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-dec2dd9e-2fc7-47ee-aa51-7898c3b5baf3 req-5731e8cf-ec79-4c30-be68-8d2ac2a56dc6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-dec2dd9e-2fc7-47ee-aa51-7898c3b5baf3 req-5731e8cf-ec79-4c30-be68-8d2ac2a56dc6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-dec2dd9e-2fc7-47ee-aa51-7898c3b5baf3 req-5731e8cf-ec79-4c30-be68-8d2ac2a56dc6 service nova] Creating event network-changed:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:53:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-dec2dd9e-2fc7-47ee-aa51-7898c3b5baf3 req-5731e8cf-ec79-4c30-be68-8d2ac2a56dc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035460 Apr 14 10:53:05 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 181/531] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:05 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08f71190-2402-402d-af67-edf9226e4fb8"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:05 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:05 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303348 Apr 14 10:53:05 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 175/532] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:53:05 2023] POST /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:11 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:11 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:11 user devstack@n-api.service[61840]: DEBUG nova.objects.instance [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'services' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=61840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:53:11 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-f170fcac-be41-49cc-8fdd-803de158b62f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:11 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-f170fcac-be41-49cc-8fdd-803de158b62f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f170fcac-be41-49cc-8fdd-803de158b62f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f170fcac-be41-49cc-8fdd-803de158b62f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f170fcac-be41-49cc-8fdd-803de158b62f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f170fcac-be41-49cc-8fdd-803de158b62f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f170fcac-be41-49cc-8fdd-803de158b62f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f170fcac-be41-49cc-8fdd-803de158b62f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:11 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/os-volume_attachments/64fbf5f9-3b53-42b6-8eb9-34688db256a2" status: 202 len: 0 microversion: 2.1 time: 0.283629 Apr 14 10:53:11 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 177/533] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:53:11 2023] DELETE /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/os-volume_attachments/64fbf5f9-3b53-42b6-8eb9-34688db256a2 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:53:11 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-f170fcac-be41-49cc-8fdd-803de158b62f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.105546 Apr 14 10:53:11 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 182/534] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 10:53:11 2023] GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb/os-interface => generated 282 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:12 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-99de8542-eacd-47c2-aee8-2e0f2c12af51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:12 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-99de8542-eacd-47c2-aee8-2e0f2c12af51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:12 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-5b1be52a-b26f-43cd-851d-ac2ffb7b0b84 req-7700863d-b354-46bb-b0f7-a5f23cd93704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd661ae0-c4bb-4117-847d-ef7e85d062fb", "tag": "e2fa8ebc-482c-460c-924a-26111123a1d5"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-99de8542-eacd-47c2-aee8-2e0f2c12af51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-99de8542-eacd-47c2-aee8-2e0f2c12af51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-99de8542-eacd-47c2-aee8-2e0f2c12af51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-99de8542-eacd-47c2-aee8-2e0f2c12af51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-99de8542-eacd-47c2-aee8-2e0f2c12af51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-99de8542-eacd-47c2-aee8-2e0f2c12af51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-5b1be52a-b26f-43cd-851d-ac2ffb7b0b84 req-7700863d-b354-46bb-b0f7-a5f23cd93704 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-5b1be52a-b26f-43cd-851d-ac2ffb7b0b84 req-7700863d-b354-46bb-b0f7-a5f23cd93704 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-5b1be52a-b26f-43cd-851d-ac2ffb7b0b84 req-7700863d-b354-46bb-b0f7-a5f23cd93704 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:12 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-5b1be52a-b26f-43cd-851d-ac2ffb7b0b84 req-7700863d-b354-46bb-b0f7-a5f23cd93704 service nova] Creating event network-changed:e2fa8ebc-482c-460c-924a-26111123a1d5 for instance cd661ae0-c4bb-4117-847d-ef7e85d062fb on user Apr 14 10:53:12 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-5b1be52a-b26f-43cd-851d-ac2ffb7b0b84 req-7700863d-b354-46bb-b0f7-a5f23cd93704 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102012 Apr 14 10:53:12 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 176/535] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:12 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-99de8542-eacd-47c2-aee8-2e0f2c12af51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb/ips" status: 200 len: 108 microversion: 2.1 time: 0.053720 Apr 14 10:53:12 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 178/536] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 10:53:12 2023] GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb/ips => generated 108 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:14 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-dd290e56-bab8-408d-ae0c-5073fb7030a6 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-dd290e56-bab8-408d-ae0c-5073fb7030a6 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-dd290e56-bab8-408d-ae0c-5073fb7030a6 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-dd290e56-bab8-408d-ae0c-5073fb7030a6 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:14 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-dd290e56-bab8-408d-ae0c-5073fb7030a6 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Going to try to stop instance {{(pid=61841) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 10:53:14 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-dd290e56-bab8-408d-ae0c-5073fb7030a6 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/action" status: 202 len: 0 microversion: 2.1 time: 0.139052 Apr 14 10:53:14 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 183/537] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:53:14 2023] POST /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:53:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-56c93a31-44a9-4ce2-87c1-c5dbfdc02db2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:14 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-56c93a31-44a9-4ce2-87c1-c5dbfdc02db2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-56c93a31-44a9-4ce2-87c1-c5dbfdc02db2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-56c93a31-44a9-4ce2-87c1-c5dbfdc02db2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-56c93a31-44a9-4ce2-87c1-c5dbfdc02db2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-56c93a31-44a9-4ce2-87c1-c5dbfdc02db2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-56c93a31-44a9-4ce2-87c1-c5dbfdc02db2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-56c93a31-44a9-4ce2-87c1-c5dbfdc02db2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:14 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-56c93a31-44a9-4ce2-87c1-c5dbfdc02db2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:53:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-56c93a31-44a9-4ce2-87c1-c5dbfdc02db2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871" status: 200 len: 1664 microversion: 2.1 time: 0.223213 Apr 14 10:53:14 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 177/538] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:53:14 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 => generated 1664 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:53:14 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-9629d4f0-dfe6-45ec-aaf4-84d1e74530d1 req-8fb23230-44b6-4fd4-8ec3-41660c622395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8586a70e-9855-4177-ac1b-cf707a4df871", "name": "network-vif-unplugged", "status": "completed", "tag": "473d9af8-25a0-4e5a-9afb-7a0c843115cc"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-9629d4f0-dfe6-45ec-aaf4-84d1e74530d1 req-8fb23230-44b6-4fd4-8ec3-41660c622395 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-9629d4f0-dfe6-45ec-aaf4-84d1e74530d1 req-8fb23230-44b6-4fd4-8ec3-41660c622395 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-9629d4f0-dfe6-45ec-aaf4-84d1e74530d1 req-8fb23230-44b6-4fd4-8ec3-41660c622395 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:14 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-9629d4f0-dfe6-45ec-aaf4-84d1e74530d1 req-8fb23230-44b6-4fd4-8ec3-41660c622395 service nova] Creating event network-vif-unplugged:473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance 8586a70e-9855-4177-ac1b-cf707a4df871 on user Apr 14 10:53:14 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-9629d4f0-dfe6-45ec-aaf4-84d1e74530d1 req-8fb23230-44b6-4fd4-8ec3-41660c622395 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063293 Apr 14 10:53:14 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 179/539] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:53:15 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e52b9d6a-ee3e-42b8-973e-d47c4ed33196"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:15 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:15 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290799 Apr 14 10:53:15 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 184/540] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:53:15 2023] POST /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:15 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-b9fe2d62-b399-4062-921e-afe378204d2f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:15 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-b9fe2d62-b399-4062-921e-afe378204d2f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b9fe2d62-b399-4062-921e-afe378204d2f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b9fe2d62-b399-4062-921e-afe378204d2f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b9fe2d62-b399-4062-921e-afe378204d2f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b9fe2d62-b399-4062-921e-afe378204d2f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b9fe2d62-b399-4062-921e-afe378204d2f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b9fe2d62-b399-4062-921e-afe378204d2f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:15 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-b9fe2d62-b399-4062-921e-afe378204d2f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] HTTP exception thrown: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. Apr 14 10:53:15 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-b9fe2d62-b399-4062-921e-afe378204d2f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Request method failure captured: Apr 14 10:53:15 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae HTTP/1.1 Apr 14 10:53:15 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:53:15 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:53:15 user devstack@n-api.service[61839]: Connection: close Apr 14 10:53:15 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:53:15 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:53:15 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:53:15 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:53:15 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS7hNCBfzIvhfOFH7PGsHkDHd5leYC7vYRencH8Ny9KJDQcJ4oIiZ-IsdyCvdSYgX4zYCps0SzSOP8E1YZ8hZc5C-J8r57KAIvTvftJ_0xXPwlAQV-PKAzMRBEJdwMhlelfgdgjvDxhYQPYds9TZ3LydDyOSNTF_LJro6yL-4KTxvMQ Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Project-Id: f8a9941095d445f48d70df26d8c90e6c Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8a9941095d445f48d70df26d8c90e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f8a9941095d445f48d70df26d8c90e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8a9941095d445f48d70df26d8c90e6c"}]}] Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Tenant-Id: f8a9941095d445f48d70df26d8c90e6c Apr 14 10:53:15 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:53:15 user devstack@n-api.service[61839]: X-User: tempest-AttachVolumeShelveTestJSON-1250068675-project-member Apr 14 10:53:15 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:53:15 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:53:15 user devstack@n-api.service[61839]: X-User-Id: 5afd3930d3a14aff8124a4782ec79870 Apr 14 10:53:15 user devstack@n-api.service[61839]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1250068675-project-member Apr 14 10:53:15 user devstack@n-api.service[61839]: method: > Apr 14 10:53:15 user devstack@n-api.service[61839]: exception: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. Apr 14 10:53:15 user devstack@n-api.service[61839]: action_args: {'id': '4b767f1b-e97e-497c-8c70-8806203c76ae'} Apr 14 10:53:15 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. Apr 14 10:53:15 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:53:15 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-b9fe2d62-b399-4062-921e-afe378204d2f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Returning 404 to user: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:53:15 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-b9fe2d62-b399-4062-921e-afe378204d2f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae" status: 404 len: 111 microversion: 2.20 time: 0.034476 Apr 14 10:53:15 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 178/541] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:53:15 2023] GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:53:15 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-077e59c4-49ef-4b51-998f-3fc2e738ccd3 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '.version_select at 0x7fcd1d029990>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:15 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-077e59c4-49ef-4b51-998f-3fc2e738ccd3 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1533515584" status: 204 len: 0 microversion: 2.20 time: 0.028451 Apr 14 10:53:15 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 180/542] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 10:53:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1533515584 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 10:53:16 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:16 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:16 user devstack@n-api.service[61841]: DEBUG nova.objects.instance [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'flavor' on Instance uuid d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=61841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:53:16 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-f5b8bd6f-88a9-422d-b63d-ead3f854b53c req-02f312dc-6607-4ebd-8d9d-cd01db75b25c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8586a70e-9855-4177-ac1b-cf707a4df871", "name": "network-vif-plugged", "status": "completed", "tag": "473d9af8-25a0-4e5a-9afb-7a0c843115cc"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f5b8bd6f-88a9-422d-b63d-ead3f854b53c req-02f312dc-6607-4ebd-8d9d-cd01db75b25c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f5b8bd6f-88a9-422d-b63d-ead3f854b53c req-02f312dc-6607-4ebd-8d9d-cd01db75b25c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f5b8bd6f-88a9-422d-b63d-ead3f854b53c req-02f312dc-6607-4ebd-8d9d-cd01db75b25c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:16 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-f5b8bd6f-88a9-422d-b63d-ead3f854b53c req-02f312dc-6607-4ebd-8d9d-cd01db75b25c service nova] Creating event network-vif-plugged:473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance 8586a70e-9855-4177-ac1b-cf707a4df871 on user Apr 14 10:53:16 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-f5b8bd6f-88a9-422d-b63d-ead3f854b53c req-02f312dc-6607-4ebd-8d9d-cd01db75b25c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101901 Apr 14 10:53:16 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 179/543] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:16 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/action" status: 200 len: 32 microversion: 2.1 time: 0.215907 Apr 14 10:53:16 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 185/544] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:53:16 2023] POST /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/action => generated 32 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:53:16 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-0031e897-f140-4377-b57e-4b9cfcaac90b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:16 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-0031e897-f140-4377-b57e-4b9cfcaac90b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0031e897-f140-4377-b57e-4b9cfcaac90b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0031e897-f140-4377-b57e-4b9cfcaac90b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0031e897-f140-4377-b57e-4b9cfcaac90b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0031e897-f140-4377-b57e-4b9cfcaac90b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0031e897-f140-4377-b57e-4b9cfcaac90b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0031e897-f140-4377-b57e-4b9cfcaac90b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:16 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-0031e897-f140-4377-b57e-4b9cfcaac90b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:53:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-0031e897-f140-4377-b57e-4b9cfcaac90b tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" status: 200 len: 1723 microversion: 2.1 time: 0.210839 Apr 14 10:53:16 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 181/545] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:53:16 2023] GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:53:17 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-26aee888-70c3-40c7-a025-4e6915b0734f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Action: 'create', calling method: .version_select at 0x7fcd1ce53250>, body: {"keypair": {"name": "tempest-keypair-2083532637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLvBNTxhHSIubw0F7uDtXu3lrC4fQZkREwo5wOypbS5+Ne2y87VyX2V16fNDjYxnAH2TEtOojObi2Pe4MMNu8MWvc1u20HwRd46X6UXa7+BJMSqgQ2sXpyz9M+hNSfjsA=="}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:17 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-26aee888-70c3-40c7-a025-4e6915b0734f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Getting quotas for project f8a9941095d445f48d70df26d8c90e6c. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:53:17 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-26aee888-70c3-40c7-a025-4e6915b0734f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Getting quotas for user 5afd3930d3a14aff8124a4782ec79870 and project f8a9941095d445f48d70df26d8c90e6c. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:53:17 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-26aee888-70c3-40c7-a025-4e6915b0734f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049788 Apr 14 10:53:17 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 180/546] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 10:53:17 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 10:53:18 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "name": "network-vif-unplugged", "status": "completed", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}, {"server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "name": "network-vif-plugged", "status": "completed", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:18 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] Creating event network-vif-unplugged:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:53:18 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] Creating event network-vif-plugged:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:53:18 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.050583 Apr 14 10:53:18 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 186/547] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:18 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:18 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1556975659", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1cb09253-66a4-4c81-82d0-c6d948e0aed4"}], "security_groups": [{"name": "tempest-securitygroup--468530379"}], "key_name": "tempest-keypair-2083532637", "user_data": "}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] validate_networks() for [('1cb09253-66a4-4c81-82d0-c6d948e0aed4', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Getting quotas for project f8a9941095d445f48d70df26d8c90e6c. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Getting quotas for user 5afd3930d3a14aff8124a4782ec79870 and project f8a9941095d445f48d70df26d8c90e6c. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:53:19 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:53:19 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.694206 Apr 14 10:53:19 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 182/548] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 10:53:18 2023] POST /compute/v2.1/servers => generated 399 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 10:53:19 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-93e8c566-6af0-4075-bda3-d81f800d6efb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:19 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-93e8c566-6af0-4075-bda3-d81f800d6efb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:19 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-93e8c566-6af0-4075-bda3-d81f800d6efb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:53:19 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-93e8c566-6af0-4075-bda3-d81f800d6efb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:53:19 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-93e8c566-6af0-4075-bda3-d81f800d6efb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:53:19 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-93e8c566-6af0-4075-bda3-d81f800d6efb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" status: 200 len: 1276 microversion: 2.20 time: 0.098719 Apr 14 10:53:19 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 181/549] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:53:19 2023] GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => generated 1276 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:53:20 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-8eef8ea0-bb03-443f-a135-f7beebca7c45 req-8fbc0113-d1e0-41c4-a050-3602df5df554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "name": "network-vif-plugged", "status": "completed", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-8eef8ea0-bb03-443f-a135-f7beebca7c45 req-8fbc0113-d1e0-41c4-a050-3602df5df554 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-8eef8ea0-bb03-443f-a135-f7beebca7c45 req-8fbc0113-d1e0-41c4-a050-3602df5df554 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-8eef8ea0-bb03-443f-a135-f7beebca7c45 req-8fbc0113-d1e0-41c4-a050-3602df5df554 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:20 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-8eef8ea0-bb03-443f-a135-f7beebca7c45 req-8fbc0113-d1e0-41c4-a050-3602df5df554 service nova] Creating event network-vif-plugged:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:53:20 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-8eef8ea0-bb03-443f-a135-f7beebca7c45 req-8fbc0113-d1e0-41c4-a050-3602df5df554 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032647 Apr 14 10:53:20 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 187/550] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:21 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:21 user devstack@n-api.service[61840]: DEBUG nova.objects.instance [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lazy-loading 'services' on Instance uuid 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d {{(pid=61840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:53:22 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/os-volume_attachments/7941e1c1-c0c5-4459-9b3e-e09e2d755f77" status: 202 len: 0 microversion: 2.1 time: 0.173179 Apr 14 10:53:22 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 183/551] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:53:21 2023] DELETE /compute/v2.1/servers/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/os-volume_attachments/7941e1c1-c0c5-4459-9b3e-e09e2d755f77 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 10:53:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:22 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:22 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:22 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:53:22 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" status: 204 len: 0 microversion: 2.1 time: 0.232193 Apr 14 10:53:22 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 182/552] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:53:22 2023] DELETE /compute/v2.1/servers/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:53:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-fa2e722e-5450-498f-866d-f06367becbae tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:22 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-fa2e722e-5450-498f-866d-f06367becbae tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fa2e722e-5450-498f-866d-f06367becbae tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fa2e722e-5450-498f-866d-f06367becbae tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fa2e722e-5450-498f-866d-f06367becbae tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fa2e722e-5450-498f-866d-f06367becbae tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fa2e722e-5450-498f-866d-f06367becbae tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fa2e722e-5450-498f-866d-f06367becbae tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:22 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-fa2e722e-5450-498f-866d-f06367becbae tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac498c56dae543cf9e64fbb61ad50df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84a2fac4604454982dc018b36440b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:53:22 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-fa2e722e-5450-498f-866d-f06367becbae tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" status: 200 len: 1549 microversion: 2.1 time: 0.177117 Apr 14 10:53:22 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 188/553] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:53:22 2023] GET /compute/v2.1/servers/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d => generated 1549 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:53:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-040416f1-66c0-4241-a87e-8a861f9f2f31 req-6b8bccf6-39bb-48af-8d02-48af350d7ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387", "tag": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-040416f1-66c0-4241-a87e-8a861f9f2f31 req-6b8bccf6-39bb-48af-8d02-48af350d7ba8 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-040416f1-66c0-4241-a87e-8a861f9f2f31 req-6b8bccf6-39bb-48af-8d02-48af350d7ba8 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-040416f1-66c0-4241-a87e-8a861f9f2f31 req-6b8bccf6-39bb-48af-8d02-48af350d7ba8 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:22 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-040416f1-66c0-4241-a87e-8a861f9f2f31 req-6b8bccf6-39bb-48af-8d02-48af350d7ba8 service nova] Creating event network-changed:1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 on user Apr 14 10:53:22 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-040416f1-66c0-4241-a87e-8a861f9f2f31 req-6b8bccf6-39bb-48af-8d02-48af350d7ba8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038621 Apr 14 10:53:22 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 184/554] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-3aa99f44-aacf-4aa2-87f7-7beedcbf1f49 req-d3bda36a-2261-4427-a3fd-0995b52d9419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "name": "network-vif-plugged", "status": "completed", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-3aa99f44-aacf-4aa2-87f7-7beedcbf1f49 req-d3bda36a-2261-4427-a3fd-0995b52d9419 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-3aa99f44-aacf-4aa2-87f7-7beedcbf1f49 req-d3bda36a-2261-4427-a3fd-0995b52d9419 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-3aa99f44-aacf-4aa2-87f7-7beedcbf1f49 req-d3bda36a-2261-4427-a3fd-0995b52d9419 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:22 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-3aa99f44-aacf-4aa2-87f7-7beedcbf1f49 req-d3bda36a-2261-4427-a3fd-0995b52d9419 service nova] Creating event network-vif-plugged:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:53:22 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-3aa99f44-aacf-4aa2-87f7-7beedcbf1f49 req-d3bda36a-2261-4427-a3fd-0995b52d9419 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046954 Apr 14 10:53:22 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 183/555] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:23 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-440b79f0-fad6-4070-9d2b-fd6d8f55a376 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d080670>, body: {"keypair": {"name": "tempest-keypair-160863978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxakvNptBAyP1cjMVTNUR7Y9sIuqqQnSxaFT8xZj4eZ6vJiU+rnz3GVavCxzbNROb7vJOXXsA/chLaRy0bXyzzLXIsm6NEmtgSBCKwqRkZOoqmVz1nPd1tzgRdcn3tDVw=="}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:23 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-440b79f0-fad6-4070-9d2b-fd6d8f55a376 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for project cb8f294f957f4c74ae959c1e9f238427. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:53:23 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-440b79f0-fad6-4070-9d2b-fd6d8f55a376 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for user 78adbbdcd10e446daddde754e46309b2 and project cb8f294f957f4c74ae959c1e9f238427. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:53:23 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-440b79f0-fad6-4070-9d2b-fd6d8f55a376 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056541 Apr 14 10:53:23 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 189/556] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 10:53:23 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:24 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d", "name": "network-vif-unplugged", "status": "completed", "tag": "ff9ac514-2d14-4580-8d6a-2c525b72a5db"}, {"server_uuid": "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d", "name": "network-vif-plugged", "status": "completed", "tag": "ff9ac514-2d14-4580-8d6a-2c525b72a5db"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:24 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:24 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:24 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:24 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] Creating event network-vif-unplugged:ff9ac514-2d14-4580-8d6a-2c525b72a5db for instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d on user Apr 14 10:53:24 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] Creating event network-vif-plugged:ff9ac514-2d14-4580-8d6a-2c525b72a5db for instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d on user Apr 14 10:53:24 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032612 Apr 14 10:53:24 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 185/557] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:24 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:25 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1573447995", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b639a68a-2b4e-435c-b98b-65b5b4981c73"}], "security_groups": [{"name": "tempest-securitygroup--1463892040"}], "key_name": "tempest-keypair-160863978", "user_data": "}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:25 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] validate_networks() for [('b639a68a-2b4e-435c-b98b-65b5b4981c73', None, None, None, None, None)] {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:53:25 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:53:25 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:53:25 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:53:25 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:53:25 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:53:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:26 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for project cb8f294f957f4c74ae959c1e9f238427. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:53:26 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for user 78adbbdcd10e446daddde754e46309b2 and project cb8f294f957f4c74ae959c1e9f238427. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:53:26 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:53:26 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:53:26 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.888384 Apr 14 10:53:26 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 184/558] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:53:25 2023] POST /compute/v2.1/servers => generated 400 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 14 10:53:26 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-797b25ea-4d04-403a-8cee-adedff2ff86f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:26 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-797b25ea-4d04-403a-8cee-adedff2ff86f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:26 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-797b25ea-4d04-403a-8cee-adedff2ff86f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:53:26 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-797b25ea-4d04-403a-8cee-adedff2ff86f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22" status: 200 len: 1235 microversion: 2.1 time: 0.096144 Apr 14 10:53:26 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 190/559] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:53:26 2023] GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22 => generated 1235 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:53:26 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387", "name": "network-vif-plugged", "status": "completed", "tag": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff"}, {"server_uuid": "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387", "name": "network-vif-plugged", "status": "completed", "tag": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff"}, {"server_uuid": "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d", "name": "network-vif-deleted", "tag": "ff9ac514-2d14-4580-8d6a-2c525b72a5db"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:26 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:26 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:26 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:26 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] Creating event network-vif-plugged:1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 on user Apr 14 10:53:26 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] Creating event network-vif-plugged:1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 on user Apr 14 10:53:26 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] Creating event network-vif-deleted:ff9ac514-2d14-4580-8d6a-2c525b72a5db for instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d on user Apr 14 10:53:26 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.055510 Apr 14 10:53:26 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 186/560] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:26 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:29 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-894762d6-c837-40ce-b7ed-79bd23025902 req-82cfa446-0ca9-4506-bb6f-5fd9c6d2e06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3393be13-7d81-48da-b6dd-a427e8403b22", "tag": "5c5720ce-d39a-4676-9116-0e5adf24d40f"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-894762d6-c837-40ce-b7ed-79bd23025902 req-82cfa446-0ca9-4506-bb6f-5fd9c6d2e06d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-894762d6-c837-40ce-b7ed-79bd23025902 req-82cfa446-0ca9-4506-bb6f-5fd9c6d2e06d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-894762d6-c837-40ce-b7ed-79bd23025902 req-82cfa446-0ca9-4506-bb6f-5fd9c6d2e06d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:29 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-894762d6-c837-40ce-b7ed-79bd23025902 req-82cfa446-0ca9-4506-bb6f-5fd9c6d2e06d service nova] Creating event network-changed:5c5720ce-d39a-4676-9116-0e5adf24d40f for instance 3393be13-7d81-48da-b6dd-a427e8403b22 on user Apr 14 10:53:29 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-894762d6-c837-40ce-b7ed-79bd23025902 req-82cfa446-0ca9-4506-bb6f-5fd9c6d2e06d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050172 Apr 14 10:53:29 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 185/561] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:31 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-5d3f21da-871f-42c5-ad42-f97453e57f65 req-278f9148-de92-430b-a24f-dfb8b636935b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3393be13-7d81-48da-b6dd-a427e8403b22", "name": "network-vif-plugged", "status": "completed", "tag": "5c5720ce-d39a-4676-9116-0e5adf24d40f"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:31 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:31 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5d3f21da-871f-42c5-ad42-f97453e57f65 req-278f9148-de92-430b-a24f-dfb8b636935b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:31 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5d3f21da-871f-42c5-ad42-f97453e57f65 req-278f9148-de92-430b-a24f-dfb8b636935b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:31 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5d3f21da-871f-42c5-ad42-f97453e57f65 req-278f9148-de92-430b-a24f-dfb8b636935b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:31 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:31 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-5d3f21da-871f-42c5-ad42-f97453e57f65 req-278f9148-de92-430b-a24f-dfb8b636935b service nova] Creating event network-vif-plugged:5c5720ce-d39a-4676-9116-0e5adf24d40f for instance 3393be13-7d81-48da-b6dd-a427e8403b22 on user Apr 14 10:53:31 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-5d3f21da-871f-42c5-ad42-f97453e57f65 req-278f9148-de92-430b-a24f-dfb8b636935b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056270 Apr 14 10:53:31 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 191/562] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:32 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:32 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:32 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:32 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:32 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:32 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/action" status: 202 len: 0 microversion: 2.1 time: 0.235266 Apr 14 10:53:32 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 187/563] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:53:32 2023] POST /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:53:32 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8e5e59a2-7da9-42ac-81e2-3677b9a70744 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:32 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-8e5e59a2-7da9-42ac-81e2-3677b9a70744 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8e5e59a2-7da9-42ac-81e2-3677b9a70744 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8e5e59a2-7da9-42ac-81e2-3677b9a70744 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8e5e59a2-7da9-42ac-81e2-3677b9a70744 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8e5e59a2-7da9-42ac-81e2-3677b9a70744 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8e5e59a2-7da9-42ac-81e2-3677b9a70744 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8e5e59a2-7da9-42ac-81e2-3677b9a70744 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:32 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-8e5e59a2-7da9-42ac-81e2-3677b9a70744 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:53:32 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-8e5e59a2-7da9-42ac-81e2-3677b9a70744 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1729 microversion: 2.1 time: 0.234408 Apr 14 10:53:32 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 186/564] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:53:32 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:53:33 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-bb5c73bf-afcb-47cb-96f5-525d51606fd9 req-efd43e19-231c-4259-8e27-9ba5ad89cb59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-unplugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-bb5c73bf-afcb-47cb-96f5-525d51606fd9 req-efd43e19-231c-4259-8e27-9ba5ad89cb59 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-bb5c73bf-afcb-47cb-96f5-525d51606fd9 req-efd43e19-231c-4259-8e27-9ba5ad89cb59 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-bb5c73bf-afcb-47cb-96f5-525d51606fd9 req-efd43e19-231c-4259-8e27-9ba5ad89cb59 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:33 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-bb5c73bf-afcb-47cb-96f5-525d51606fd9 req-efd43e19-231c-4259-8e27-9ba5ad89cb59 service nova] Creating event network-vif-unplugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:53:33 user devstack@n-api.service[61841]: DEBUG nova.compute.api [req-bb5c73bf-afcb-47cb-96f5-525d51606fd9 req-efd43e19-231c-4259-8e27-9ba5ad89cb59 service nova] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61841) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 10:53:33 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-bb5c73bf-afcb-47cb-96f5-525d51606fd9 req-efd43e19-231c-4259-8e27-9ba5ad89cb59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057808 Apr 14 10:53:33 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 192/565] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:53:34 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-65b2e5a8-ba71-4078-af97-bee058598735 req-9f1a73c2-423f-43d2-9172-32b30627f1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3393be13-7d81-48da-b6dd-a427e8403b22", "name": "network-vif-plugged", "status": "completed", "tag": "5c5720ce-d39a-4676-9116-0e5adf24d40f"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-65b2e5a8-ba71-4078-af97-bee058598735 req-9f1a73c2-423f-43d2-9172-32b30627f1f9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-65b2e5a8-ba71-4078-af97-bee058598735 req-9f1a73c2-423f-43d2-9172-32b30627f1f9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-65b2e5a8-ba71-4078-af97-bee058598735 req-9f1a73c2-423f-43d2-9172-32b30627f1f9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-65b2e5a8-ba71-4078-af97-bee058598735 req-9f1a73c2-423f-43d2-9172-32b30627f1f9 service nova] Creating event network-vif-plugged:5c5720ce-d39a-4676-9116-0e5adf24d40f for instance 3393be13-7d81-48da-b6dd-a427e8403b22 on user Apr 14 10:53:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-65b2e5a8-ba71-4078-af97-bee058598735 req-9f1a73c2-423f-43d2-9172-32b30627f1f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029054 Apr 14 10:53:34 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 188/566] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:35 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-edfc7a2c-3ac3-46b7-9679-101273d8b6c9 req-825eb0fe-25b8-4658-bde3-2669969c8e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-plugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:35 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-edfc7a2c-3ac3-46b7-9679-101273d8b6c9 req-825eb0fe-25b8-4658-bde3-2669969c8e35 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-edfc7a2c-3ac3-46b7-9679-101273d8b6c9 req-825eb0fe-25b8-4658-bde3-2669969c8e35 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-edfc7a2c-3ac3-46b7-9679-101273d8b6c9 req-825eb0fe-25b8-4658-bde3-2669969c8e35 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:35 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-edfc7a2c-3ac3-46b7-9679-101273d8b6c9 req-825eb0fe-25b8-4658-bde3-2669969c8e35 service nova] Creating event network-vif-plugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:53:35 user devstack@n-api.service[61839]: DEBUG nova.compute.api [req-edfc7a2c-3ac3-46b7-9679-101273d8b6c9 req-825eb0fe-25b8-4658-bde3-2669969c8e35 service nova] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61839) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 10:53:35 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-edfc7a2c-3ac3-46b7-9679-101273d8b6c9 req-825eb0fe-25b8-4658-bde3-2669969c8e35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072304 Apr 14 10:53:35 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 187/567] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:45 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:45 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:45 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=5 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:45 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-84df0f8e-e8f9-475b-b25e-fe3657b6f6e5 req-ca20dfb8-9041-49f9-bafe-13e18ebf24f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-plugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-84df0f8e-e8f9-475b-b25e-fe3657b6f6e5 req-ca20dfb8-9041-49f9-bafe-13e18ebf24f9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-84df0f8e-e8f9-475b-b25e-fe3657b6f6e5 req-ca20dfb8-9041-49f9-bafe-13e18ebf24f9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-84df0f8e-e8f9-475b-b25e-fe3657b6f6e5 req-ca20dfb8-9041-49f9-bafe-13e18ebf24f9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:45 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-84df0f8e-e8f9-475b-b25e-fe3657b6f6e5 req-ca20dfb8-9041-49f9-bafe-13e18ebf24f9 service nova] Creating event network-vif-plugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:53:45 user devstack@n-api.service[61841]: DEBUG nova.compute.api [req-84df0f8e-e8f9-475b-b25e-fe3657b6f6e5 req-ca20dfb8-9041-49f9-bafe-13e18ebf24f9 service nova] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61841) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 10:53:45 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-84df0f8e-e8f9-475b-b25e-fe3657b6f6e5 req-ca20dfb8-9041-49f9-bafe-13e18ebf24f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057265 Apr 14 10:53:45 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 193/568] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:47 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:47 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:47 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-74de430f-35d6-4a41-881e-3bd4cf5794af req-858e1d66-c4cd-4539-84cd-5b7f40b5bfda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-plugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-74de430f-35d6-4a41-881e-3bd4cf5794af req-858e1d66-c4cd-4539-84cd-5b7f40b5bfda service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-74de430f-35d6-4a41-881e-3bd4cf5794af req-858e1d66-c4cd-4539-84cd-5b7f40b5bfda service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-74de430f-35d6-4a41-881e-3bd4cf5794af req-858e1d66-c4cd-4539-84cd-5b7f40b5bfda service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:47 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-74de430f-35d6-4a41-881e-3bd4cf5794af req-858e1d66-c4cd-4539-84cd-5b7f40b5bfda service nova] Creating event network-vif-plugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:53:47 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-74de430f-35d6-4a41-881e-3bd4cf5794af req-858e1d66-c4cd-4539-84cd-5b7f40b5bfda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040337 Apr 14 10:53:47 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 189/569] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:53:53 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:53 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=12 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:53 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:53 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:53 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-26b23cf4-0ed1-44fd-8f61-6316bf018509 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:53 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-26b23cf4-0ed1-44fd-8f61-6316bf018509 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26b23cf4-0ed1-44fd-8f61-6316bf018509 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26b23cf4-0ed1-44fd-8f61-6316bf018509 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26b23cf4-0ed1-44fd-8f61-6316bf018509 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26b23cf4-0ed1-44fd-8f61-6316bf018509 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26b23cf4-0ed1-44fd-8f61-6316bf018509 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26b23cf4-0ed1-44fd-8f61-6316bf018509 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:53 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-26b23cf4-0ed1-44fd-8f61-6316bf018509 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] HTTP exception thrown: Instance 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 could not be found. Apr 14 10:53:53 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-26b23cf4-0ed1-44fd-8f61-6316bf018509 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Request method failure captured: Apr 14 10:53:53 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 HTTP/1.1 Apr 14 10:53:53 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:53:53 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:53:53 user devstack@n-api.service[61839]: Connection: close Apr 14 10:53:53 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:53:53 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:53:53 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:53:53 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:53:53 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:53:53 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS9iEPr1h2w4OctNYeVV-kqEukMcmFHEUxgLZg25IJ1Wfv6VMHMjd9Bx_nLj8cHKg0L2mON-qVq8RxUKC-Mx1vX7eStRs-42xqRiTO5zMRWhPJnE3zTfY2QbP_bmFuoF5ubcxEtd7WTW4bXXb8BKLRXzo_N2Jrad3o09gbjIOV_RLpc Apr 14 10:53:53 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:53:53 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:53:53 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:53:53 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:53:53 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:53:53 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:53:53 user devstack@n-api.service[61839]: X-Project-Id: aca26975e5ad4524b4b1b1ec4335802f Apr 14 10:53:53 user devstack@n-api.service[61839]: X-Project-Name: tempest-VolumesAdminNegativeTest-5408590 Apr 14 10:53:53 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:53:53 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:53:53 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aca26975e5ad4524b4b1b1ec4335802f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/aca26975e5ad4524b4b1b1ec4335802f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aca26975e5ad4524b4b1b1ec4335802f"}]}] Apr 14 10:53:53 user devstack@n-api.service[61839]: X-Tenant: tempest-VolumesAdminNegativeTest-5408590 Apr 14 10:53:53 user devstack@n-api.service[61839]: X-Tenant-Id: aca26975e5ad4524b4b1b1ec4335802f Apr 14 10:53:53 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-5408590 Apr 14 10:53:53 user devstack@n-api.service[61839]: X-User: tempest-VolumesAdminNegativeTest-5408590-project-member Apr 14 10:53:53 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:53:53 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:53:53 user devstack@n-api.service[61839]: X-User-Id: 6adefa90332c42c79a1372258a7be5ab Apr 14 10:53:53 user devstack@n-api.service[61839]: X-User-Name: tempest-VolumesAdminNegativeTest-5408590-project-member Apr 14 10:53:53 user devstack@n-api.service[61839]: method: > Apr 14 10:53:53 user devstack@n-api.service[61839]: exception: Instance 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 could not be found. Apr 14 10:53:53 user devstack@n-api.service[61839]: action_args: {'id': '3b4b6e3e-0743-4ee6-900c-3172b09eb0f2'} Apr 14 10:53:53 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 could not be found. Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 could not be found. Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 could not be found. Apr 14 10:53:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:53:53 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-26b23cf4-0ed1-44fd-8f61-6316bf018509 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Returning 404 to user: Instance 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:53:53 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-26b23cf4-0ed1-44fd-8f61-6316bf018509 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" status: 404 len: 111 microversion: 2.1 time: 0.152801 Apr 14 10:53:53 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 188/570] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:53:53 2023] GET /compute/v2.1/servers/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:53:56 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:56 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:53:56 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:56 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:56 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:53:56 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9" status: 204 len: 0 microversion: 2.1 time: 0.147205 Apr 14 10:53:56 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 194/571] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:53:56 2023] DELETE /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:53:56 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-fe5c288c-d1e8-45ab-bd1e-f20c59141019 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:56 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-fe5c288c-d1e8-45ab-bd1e-f20c59141019 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fe5c288c-d1e8-45ab-bd1e-f20c59141019 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fe5c288c-d1e8-45ab-bd1e-f20c59141019 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fe5c288c-d1e8-45ab-bd1e-f20c59141019 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fe5c288c-d1e8-45ab-bd1e-f20c59141019 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fe5c288c-d1e8-45ab-bd1e-f20c59141019 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fe5c288c-d1e8-45ab-bd1e-f20c59141019 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:56 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-fe5c288c-d1e8-45ab-bd1e-f20c59141019 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6adefa90332c42c79a1372258a7be5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca26975e5ad4524b4b1b1ec4335802f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:53:56 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-58540dc3-2bf3-45b0-96bf-3e5a16fec148 req-feb37da4-86b5-465d-9ffd-ca61f722c613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3245b74-dbe8-4b8b-83b6-58a4811fdba9", "name": "network-vif-unplugged", "status": "completed", "tag": "9abeb28a-35f1-4e16-a152-ed2578e8a678"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:56 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-fe5c288c-d1e8-45ab-bd1e-f20c59141019 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9" status: 200 len: 1667 microversion: 2.1 time: 0.279892 Apr 14 10:53:56 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 190/572] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:53:56 2023] GET /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9 => generated 1667 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:53:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-58540dc3-2bf3-45b0-96bf-3e5a16fec148 req-feb37da4-86b5-465d-9ffd-ca61f722c613 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-58540dc3-2bf3-45b0-96bf-3e5a16fec148 req-feb37da4-86b5-465d-9ffd-ca61f722c613 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-58540dc3-2bf3-45b0-96bf-3e5a16fec148 req-feb37da4-86b5-465d-9ffd-ca61f722c613 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:56 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-58540dc3-2bf3-45b0-96bf-3e5a16fec148 req-feb37da4-86b5-465d-9ffd-ca61f722c613 service nova] Creating event network-vif-unplugged:9abeb28a-35f1-4e16-a152-ed2578e8a678 for instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 on user Apr 14 10:53:56 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-58540dc3-2bf3-45b0-96bf-3e5a16fec148 req-feb37da4-86b5-465d-9ffd-ca61f722c613 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037472 Apr 14 10:53:56 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 189/573] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:58 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-ec83556b-01c7-43c5-8db8-baaf9f9e2f38 req-1854d711-1e7f-430b-b57f-7e3bae9ac71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3245b74-dbe8-4b8b-83b6-58a4811fdba9", "name": "network-vif-deleted", "tag": "9abeb28a-35f1-4e16-a152-ed2578e8a678"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ec83556b-01c7-43c5-8db8-baaf9f9e2f38 req-1854d711-1e7f-430b-b57f-7e3bae9ac71b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ec83556b-01c7-43c5-8db8-baaf9f9e2f38 req-1854d711-1e7f-430b-b57f-7e3bae9ac71b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ec83556b-01c7-43c5-8db8-baaf9f9e2f38 req-1854d711-1e7f-430b-b57f-7e3bae9ac71b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:58 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-ec83556b-01c7-43c5-8db8-baaf9f9e2f38 req-1854d711-1e7f-430b-b57f-7e3bae9ac71b service nova] Creating event network-vif-deleted:9abeb28a-35f1-4e16-a152-ed2578e8a678 for instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 on user Apr 14 10:53:58 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-ec83556b-01c7-43c5-8db8-baaf9f9e2f38 req-1854d711-1e7f-430b-b57f-7e3bae9ac71b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032990 Apr 14 10:53:58 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 195/574] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:58 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-c0756a38-bd0c-4ab1-bbc4-40a4d3513b76 req-bfc14849-9432-4ea0-8021-7b8363cd1b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3245b74-dbe8-4b8b-83b6-58a4811fdba9", "name": "network-vif-plugged", "status": "completed", "tag": "9abeb28a-35f1-4e16-a152-ed2578e8a678"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-c0756a38-bd0c-4ab1-bbc4-40a4d3513b76 req-bfc14849-9432-4ea0-8021-7b8363cd1b00 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-c0756a38-bd0c-4ab1-bbc4-40a4d3513b76 req-bfc14849-9432-4ea0-8021-7b8363cd1b00 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-c0756a38-bd0c-4ab1-bbc4-40a4d3513b76 req-bfc14849-9432-4ea0-8021-7b8363cd1b00 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:58 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-c0756a38-bd0c-4ab1-bbc4-40a4d3513b76 req-bfc14849-9432-4ea0-8021-7b8363cd1b00 service nova] Creating event network-vif-plugged:9abeb28a-35f1-4e16-a152-ed2578e8a678 for instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 on user Apr 14 10:53:58 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-c0756a38-bd0c-4ab1-bbc4-40a4d3513b76 req-bfc14849-9432-4ea0-8021-7b8363cd1b00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030492 Apr 14 10:53:58 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 191/575] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:53:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:53:59 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:53:59 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416/action" status: 202 len: 0 microversion: 2.87 time: 0.079382 Apr 14 10:53:59 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 190/576] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 10:53:59 2023] POST /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:53:59 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-24455e4d-ca5f-4ca7-91a3-271b9c96dc34 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:53:59 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-24455e4d-ca5f-4ca7-91a3-271b9c96dc34 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:53:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-24455e4d-ca5f-4ca7-91a3-271b9c96dc34 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-24455e4d-ca5f-4ca7-91a3-271b9c96dc34 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-24455e4d-ca5f-4ca7-91a3-271b9c96dc34 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:53:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-24455e4d-ca5f-4ca7-91a3-271b9c96dc34 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:53:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-24455e4d-ca5f-4ca7-91a3-271b9c96dc34 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:53:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-24455e4d-ca5f-4ca7-91a3-271b9c96dc34 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:00 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-24455e4d-ca5f-4ca7-91a3-271b9c96dc34 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:54:00 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-24455e4d-ca5f-4ca7-91a3-271b9c96dc34 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:54:00 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-24455e4d-ca5f-4ca7-91a3-271b9c96dc34 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:54:00 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-24455e4d-ca5f-4ca7-91a3-271b9c96dc34 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416" status: 200 len: 1763 microversion: 2.87 time: 0.166664 Apr 14 10:54:00 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 196/577] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:53:59 2023] GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416 => generated 1763 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:54:00 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-392e172d-cb5f-48b9-adf2-9c097767417c req-32b5a175-6ad2-4b7e-baa2-0d3338ac617f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cae9f61-763f-4671-a873-d15f01384416", "name": "network-vif-unplugged", "status": "completed", "tag": "30d57100-3321-41fe-9335-d53c8c5e291c"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:54:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-392e172d-cb5f-48b9-adf2-9c097767417c req-32b5a175-6ad2-4b7e-baa2-0d3338ac617f service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-392e172d-cb5f-48b9-adf2-9c097767417c req-32b5a175-6ad2-4b7e-baa2-0d3338ac617f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-392e172d-cb5f-48b9-adf2-9c097767417c req-32b5a175-6ad2-4b7e-baa2-0d3338ac617f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:00 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-392e172d-cb5f-48b9-adf2-9c097767417c req-32b5a175-6ad2-4b7e-baa2-0d3338ac617f service nova] Creating event network-vif-unplugged:30d57100-3321-41fe-9335-d53c8c5e291c for instance 6cae9f61-763f-4671-a873-d15f01384416 on user Apr 14 10:54:00 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-392e172d-cb5f-48b9-adf2-9c097767417c req-32b5a175-6ad2-4b7e-baa2-0d3338ac617f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034080 Apr 14 10:54:00 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 192/578] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:54:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:54:03 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cae9f61-763f-4671-a873-d15f01384416", "name": "network-vif-plugged", "status": "completed", "tag": "30d57100-3321-41fe-9335-d53c8c5e291c"}, {"server_uuid": "6cae9f61-763f-4671-a873-d15f01384416", "name": "network-vif-plugged", "status": "completed", "tag": "30d57100-3321-41fe-9335-d53c8c5e291c"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:54:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:03 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] Creating event network-vif-plugged:30d57100-3321-41fe-9335-d53c8c5e291c for instance 6cae9f61-763f-4671-a873-d15f01384416 on user Apr 14 10:54:03 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] Creating event network-vif-plugged:30d57100-3321-41fe-9335-d53c8c5e291c for instance 6cae9f61-763f-4671-a873-d15f01384416 on user Apr 14 10:54:03 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033976 Apr 14 10:54:03 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 191/579] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:54:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:54:04 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-96d9342b-34b7-4443-bea8-e9d4f9a148c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:54:04 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-96d9342b-34b7-4443-bea8-e9d4f9a148c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:54:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-96d9342b-34b7-4443-bea8-e9d4f9a148c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-96d9342b-34b7-4443-bea8-e9d4f9a148c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-96d9342b-34b7-4443-bea8-e9d4f9a148c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-96d9342b-34b7-4443-bea8-e9d4f9a148c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-96d9342b-34b7-4443-bea8-e9d4f9a148c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-96d9342b-34b7-4443-bea8-e9d4f9a148c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:04 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-96d9342b-34b7-4443-bea8-e9d4f9a148c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:54:04 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-96d9342b-34b7-4443-bea8-e9d4f9a148c3 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871" status: 200 len: 1641 microversion: 2.1 time: 0.145342 Apr 14 10:54:04 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 197/580] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:54:04 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 => generated 1641 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:54:05 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-ae13fa73-8933-4e58-9a9f-7ca5502ccdf1 req-d831a986-f3e0-4789-b4a5-34f8b1e3fda7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cae9f61-763f-4671-a873-d15f01384416", "name": "network-vif-plugged", "status": "completed", "tag": "30d57100-3321-41fe-9335-d53c8c5e291c"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:54:05 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ae13fa73-8933-4e58-9a9f-7ca5502ccdf1 req-d831a986-f3e0-4789-b4a5-34f8b1e3fda7 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:05 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ae13fa73-8933-4e58-9a9f-7ca5502ccdf1 req-d831a986-f3e0-4789-b4a5-34f8b1e3fda7 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:05 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-ae13fa73-8933-4e58-9a9f-7ca5502ccdf1 req-d831a986-f3e0-4789-b4a5-34f8b1e3fda7 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:05 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-ae13fa73-8933-4e58-9a9f-7ca5502ccdf1 req-d831a986-f3e0-4789-b4a5-34f8b1e3fda7 service nova] Creating event network-vif-plugged:30d57100-3321-41fe-9335-d53c8c5e291c for instance 6cae9f61-763f-4671-a873-d15f01384416 on user Apr 14 10:54:05 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-ae13fa73-8933-4e58-9a9f-7ca5502ccdf1 req-d831a986-f3e0-4789-b4a5-34f8b1e3fda7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030223 Apr 14 10:54:05 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 193/581] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:54:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:54:07 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-b63cb6b9-4792-431c-b1d9-a4a333043805 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:54:07 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-b63cb6b9-4792-431c-b1d9-a4a333043805 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:54:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b63cb6b9-4792-431c-b1d9-a4a333043805 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b63cb6b9-4792-431c-b1d9-a4a333043805 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b63cb6b9-4792-431c-b1d9-a4a333043805 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b63cb6b9-4792-431c-b1d9-a4a333043805 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b63cb6b9-4792-431c-b1d9-a4a333043805 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b63cb6b9-4792-431c-b1d9-a4a333043805 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:07 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-b63cb6b9-4792-431c-b1d9-a4a333043805 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:54:07 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-b63cb6b9-4792-431c-b1d9-a4a333043805 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" status: 200 len: 1703 microversion: 2.1 time: 0.167680 Apr 14 10:54:07 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 192/582] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:54:07 2023] GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => generated 1703 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:54:09 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-461cef55-37aa-4eeb-987a-164926bb93e6 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:54:09 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-461cef55-37aa-4eeb-987a-164926bb93e6 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:54:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-461cef55-37aa-4eeb-987a-164926bb93e6 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-461cef55-37aa-4eeb-987a-164926bb93e6 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-461cef55-37aa-4eeb-987a-164926bb93e6 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-461cef55-37aa-4eeb-987a-164926bb93e6 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-461cef55-37aa-4eeb-987a-164926bb93e6 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-461cef55-37aa-4eeb-987a-164926bb93e6 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:10 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-461cef55-37aa-4eeb-987a-164926bb93e6 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:54:10 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-461cef55-37aa-4eeb-987a-164926bb93e6 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:54:10 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-461cef55-37aa-4eeb-987a-164926bb93e6 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:54:10 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-461cef55-37aa-4eeb-987a-164926bb93e6 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" status: 200 len: 1587 microversion: 2.20 time: 0.167197 Apr 14 10:54:10 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 198/583] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:54:09 2023] GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => generated 1587 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:54:12 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-56e45924-86a8-4387-9b24-64f01d06c3c9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:54:12 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-56e45924-86a8-4387-9b24-64f01d06c3c9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:54:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-56e45924-86a8-4387-9b24-64f01d06c3c9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-56e45924-86a8-4387-9b24-64f01d06c3c9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-56e45924-86a8-4387-9b24-64f01d06c3c9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-56e45924-86a8-4387-9b24-64f01d06c3c9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-56e45924-86a8-4387-9b24-64f01d06c3c9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-56e45924-86a8-4387-9b24-64f01d06c3c9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:12 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-56e45924-86a8-4387-9b24-64f01d06c3c9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] HTTP exception thrown: Instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d could not be found. Apr 14 10:54:12 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-56e45924-86a8-4387-9b24-64f01d06c3c9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Request method failure captured: Apr 14 10:54:12 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d HTTP/1.1 Apr 14 10:54:12 user devstack@n-api.service[61840]: Accept: application/json Apr 14 10:54:12 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 10:54:12 user devstack@n-api.service[61840]: Connection: close Apr 14 10:54:12 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 10:54:12 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 10:54:12 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 10:54:12 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 10:54:12 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 10:54:12 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS9B1m0NjVHQTI-GqSMe1S0iDS9dg5yDlJN7cAobuIhhvHVE8vH708pJ-pPKz1M2iEly1Sh9OVk5eFKG4vlxTsXtI-IozpNXpTa-FkPkRt-aGyFI-R1QLjnuh9pGZEUyR6rVwHawJ6Ih0-6gJe27LrheIKXui5CH_9syFhUK0l-6XDg Apr 14 10:54:12 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 10:54:12 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 10:54:12 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 10:54:12 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 10:54:12 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 10:54:12 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 10:54:12 user devstack@n-api.service[61840]: X-Project-Id: a84a2fac4604454982dc018b36440b00 Apr 14 10:54:12 user devstack@n-api.service[61840]: X-Project-Name: tempest-VolumesSnapshotTestJSON-685456681 Apr 14 10:54:12 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 10:54:12 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 10:54:12 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a84a2fac4604454982dc018b36440b00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a84a2fac4604454982dc018b36440b00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a84a2fac4604454982dc018b36440b00"}]}] Apr 14 10:54:12 user devstack@n-api.service[61840]: X-Tenant: tempest-VolumesSnapshotTestJSON-685456681 Apr 14 10:54:12 user devstack@n-api.service[61840]: X-Tenant-Id: a84a2fac4604454982dc018b36440b00 Apr 14 10:54:12 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-685456681 Apr 14 10:54:12 user devstack@n-api.service[61840]: X-User: tempest-VolumesSnapshotTestJSON-685456681-project-member Apr 14 10:54:12 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 10:54:12 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 10:54:12 user devstack@n-api.service[61840]: X-User-Id: ac498c56dae543cf9e64fbb61ad50df3 Apr 14 10:54:12 user devstack@n-api.service[61840]: X-User-Name: tempest-VolumesSnapshotTestJSON-685456681-project-member Apr 14 10:54:12 user devstack@n-api.service[61840]: method: > Apr 14 10:54:12 user devstack@n-api.service[61840]: exception: Instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d could not be found. Apr 14 10:54:12 user devstack@n-api.service[61840]: action_args: {'id': '3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d'} Apr 14 10:54:12 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d could not be found. Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d could not be found. Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d could not be found. Apr 14 10:54:12 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:54:12 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-56e45924-86a8-4387-9b24-64f01d06c3c9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Returning 404 to user: Instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:54:12 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-56e45924-86a8-4387-9b24-64f01d06c3c9 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" status: 404 len: 111 microversion: 2.1 time: 0.029051 Apr 14 10:54:12 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 194/584] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:54:12 2023] GET /compute/v2.1/servers/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:54:16 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-b568d1f1-d604-42ac-8393-7fea9b2fa32e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:54:16 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-b568d1f1-d604-42ac-8393-7fea9b2fa32e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:54:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b568d1f1-d604-42ac-8393-7fea9b2fa32e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b568d1f1-d604-42ac-8393-7fea9b2fa32e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b568d1f1-d604-42ac-8393-7fea9b2fa32e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b568d1f1-d604-42ac-8393-7fea9b2fa32e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b568d1f1-d604-42ac-8393-7fea9b2fa32e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b568d1f1-d604-42ac-8393-7fea9b2fa32e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:16 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-b568d1f1-d604-42ac-8393-7fea9b2fa32e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:54:16 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-b568d1f1-d604-42ac-8393-7fea9b2fa32e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22" status: 200 len: 1546 microversion: 2.1 time: 0.175457 Apr 14 10:54:16 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 193/585] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:54:16 2023] GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22 => generated 1546 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:54:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-8b98cbcc-67f5-4203-a7b9-8cb448a6d223 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:54:22 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-8b98cbcc-67f5-4203-a7b9-8cb448a6d223 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:54:22 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:54:22 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:54:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8b98cbcc-67f5-4203-a7b9-8cb448a6d223 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8b98cbcc-67f5-4203-a7b9-8cb448a6d223 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8b98cbcc-67f5-4203-a7b9-8cb448a6d223 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8b98cbcc-67f5-4203-a7b9-8cb448a6d223 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8b98cbcc-67f5-4203-a7b9-8cb448a6d223 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8b98cbcc-67f5-4203-a7b9-8cb448a6d223 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:22 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-8b98cbcc-67f5-4203-a7b9-8cb448a6d223 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:54:22 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-8b98cbcc-67f5-4203-a7b9-8cb448a6d223 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1722 microversion: 2.1 time: 0.157612 Apr 14 10:54:22 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 199/586] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:54:22 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:54:46 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-09e31b0d-6103-46c6-a990-4bd68a52bd00 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:54:46 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-09e31b0d-6103-46c6-a990-4bd68a52bd00 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:54:46 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=12 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:54:46 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=16 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:54:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-09e31b0d-6103-46c6-a990-4bd68a52bd00 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-09e31b0d-6103-46c6-a990-4bd68a52bd00 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-09e31b0d-6103-46c6-a990-4bd68a52bd00 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-09e31b0d-6103-46c6-a990-4bd68a52bd00 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-09e31b0d-6103-46c6-a990-4bd68a52bd00 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-09e31b0d-6103-46c6-a990-4bd68a52bd00 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:46 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-09e31b0d-6103-46c6-a990-4bd68a52bd00 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] HTTP exception thrown: Instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 could not be found. Apr 14 10:54:46 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-09e31b0d-6103-46c6-a990-4bd68a52bd00 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Request method failure captured: Apr 14 10:54:46 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9 HTTP/1.1 Apr 14 10:54:46 user devstack@n-api.service[61840]: Accept: application/json Apr 14 10:54:46 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 10:54:46 user devstack@n-api.service[61840]: Connection: close Apr 14 10:54:46 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 10:54:46 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 10:54:46 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 10:54:46 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 10:54:46 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 10:54:46 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS9iEPr1h2w4OctNYeVV-kqEukMcmFHEUxgLZg25IJ1Wfv6VMHMjd9Bx_nLj8cHKg0L2mON-qVq8RxUKC-Mx1vX7eStRs-42xqRiTO5zMRWhPJnE3zTfY2QbP_bmFuoF5ubcxEtd7WTW4bXXb8BKLRXzo_N2Jrad3o09gbjIOV_RLpc Apr 14 10:54:46 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 10:54:46 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 10:54:46 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 10:54:46 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 10:54:46 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 10:54:46 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 10:54:46 user devstack@n-api.service[61840]: X-Project-Id: aca26975e5ad4524b4b1b1ec4335802f Apr 14 10:54:46 user devstack@n-api.service[61840]: X-Project-Name: tempest-VolumesAdminNegativeTest-5408590 Apr 14 10:54:46 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 10:54:46 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 10:54:46 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aca26975e5ad4524b4b1b1ec4335802f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/aca26975e5ad4524b4b1b1ec4335802f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/aca26975e5ad4524b4b1b1ec4335802f"}]}] Apr 14 10:54:46 user devstack@n-api.service[61840]: X-Tenant: tempest-VolumesAdminNegativeTest-5408590 Apr 14 10:54:46 user devstack@n-api.service[61840]: X-Tenant-Id: aca26975e5ad4524b4b1b1ec4335802f Apr 14 10:54:46 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-5408590 Apr 14 10:54:46 user devstack@n-api.service[61840]: X-User: tempest-VolumesAdminNegativeTest-5408590-project-member Apr 14 10:54:46 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 10:54:46 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 10:54:46 user devstack@n-api.service[61840]: X-User-Id: 6adefa90332c42c79a1372258a7be5ab Apr 14 10:54:46 user devstack@n-api.service[61840]: X-User-Name: tempest-VolumesAdminNegativeTest-5408590-project-member Apr 14 10:54:46 user devstack@n-api.service[61840]: method: > Apr 14 10:54:46 user devstack@n-api.service[61840]: exception: Instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 could not be found. Apr 14 10:54:46 user devstack@n-api.service[61840]: action_args: {'id': 'f3245b74-dbe8-4b8b-83b6-58a4811fdba9'} Apr 14 10:54:46 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 could not be found. Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 could not be found. Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 could not be found. Apr 14 10:54:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:54:46 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-09e31b0d-6103-46c6-a990-4bd68a52bd00 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Returning 404 to user: Instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:54:46 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-09e31b0d-6103-46c6-a990-4bd68a52bd00 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9" status: 404 len: 111 microversion: 2.1 time: 0.038942 Apr 14 10:54:46 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 195/587] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:54:46 2023] GET /compute/v2.1/servers/f3245b74-dbe8-4b8b-83b6-58a4811fdba9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:54:46 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-fbaa5a50-c4b0-4994-ac1a-0bbbce3400fe tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Calling method '.version_select at 0x7fcd1ce50280>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:54:46 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=12 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:54:46 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:54:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-fbaa5a50-c4b0-4994-ac1a-0bbbce3400fe tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-685259735" status: 202 len: 0 microversion: 2.1 time: 0.032591 Apr 14 10:54:46 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 194/588] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 10:54:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-685259735 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:54:50 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-0bca68f4-3b35-4c21-9a16-63f0c6ce617d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:54:50 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-0bca68f4-3b35-4c21-9a16-63f0c6ce617d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:54:50 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:54:50 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:54:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0bca68f4-3b35-4c21-9a16-63f0c6ce617d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0bca68f4-3b35-4c21-9a16-63f0c6ce617d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0bca68f4-3b35-4c21-9a16-63f0c6ce617d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0bca68f4-3b35-4c21-9a16-63f0c6ce617d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:54:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0bca68f4-3b35-4c21-9a16-63f0c6ce617d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:54:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0bca68f4-3b35-4c21-9a16-63f0c6ce617d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:54:50 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-0bca68f4-3b35-4c21-9a16-63f0c6ce617d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:54:50 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-0bca68f4-3b35-4c21-9a16-63f0c6ce617d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:54:50 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-0bca68f4-3b35-4c21-9a16-63f0c6ce617d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:54:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-0bca68f4-3b35-4c21-9a16-63f0c6ce617d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416" status: 200 len: 1769 microversion: 2.87 time: 0.263310 Apr 14 10:54:50 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 200/589] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:54:50 2023] GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416 => generated 1769 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1683745900", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "networks": [{"uuid": "0d829782-2ea4-4af3-8460-468b818423dc"}]}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] validate_networks() for [('0d829782-2ea4-4af3-8460-468b818423dc', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Getting quotas for project be1c0764b8a843808158644eb90704e6. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Getting quotas for user b3f2157c5d4d441db80ea4a3ca60e4dc and project be1c0764b8a843808158644eb90704e6. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:55:04 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:04 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:04 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.655510 Apr 14 10:55:04 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 196/590] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:55:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:55:04 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Going to try to start instance {{(pid=61839) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 10:55:04 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-0c62fb94-b16e-4a84-bd40-378ee01634cd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:04 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-0c62fb94-b16e-4a84-bd40-378ee01634cd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:04 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:04 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:04 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/action" status: 202 len: 0 microversion: 2.1 time: 0.088760 Apr 14 10:55:04 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 195/591] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:55:04 2023] POST /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d35defe8-8174-4a33-be83-7a74fb2ce653 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-d35defe8-8174-4a33-be83-7a74fb2ce653 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d35defe8-8174-4a33-be83-7a74fb2ce653 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d35defe8-8174-4a33-be83-7a74fb2ce653 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d35defe8-8174-4a33-be83-7a74fb2ce653 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d35defe8-8174-4a33-be83-7a74fb2ce653 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d35defe8-8174-4a33-be83-7a74fb2ce653 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d35defe8-8174-4a33-be83-7a74fb2ce653 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:04 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-0c62fb94-b16e-4a84-bd40-378ee01634cd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f2157c5d4d441db80ea4a3ca60e4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1c0764b8a843808158644eb90704e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:04 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-0c62fb94-b16e-4a84-bd40-378ee01634cd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96" status: 200 len: 1211 microversion: 2.1 time: 0.150390 Apr 14 10:55:04 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 201/592] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:55:04 2023] GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96 => generated 1211 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:55:05 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-d35defe8-8174-4a33-be83-7a74fb2ce653 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:05 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d35defe8-8174-4a33-be83-7a74fb2ce653 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871" status: 200 len: 1650 microversion: 2.1 time: 0.278368 Apr 14 10:55:05 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 197/593] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:55:04 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 => generated 1650 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:55:07 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-9a8f2950-89a5-466d-ba3c-cdc9d595fd09 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:07 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-9a8f2950-89a5-466d-ba3c-cdc9d595fd09 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9a8f2950-89a5-466d-ba3c-cdc9d595fd09 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9a8f2950-89a5-466d-ba3c-cdc9d595fd09 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9a8f2950-89a5-466d-ba3c-cdc9d595fd09 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9a8f2950-89a5-466d-ba3c-cdc9d595fd09 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9a8f2950-89a5-466d-ba3c-cdc9d595fd09 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9a8f2950-89a5-466d-ba3c-cdc9d595fd09 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:07 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-9a8f2950-89a5-466d-ba3c-cdc9d595fd09 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] HTTP exception thrown: Cannot 'detach_volume' instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 while it is in vm_state rescued Apr 14 10:55:07 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-9a8f2950-89a5-466d-ba3c-cdc9d595fd09 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Request method failure captured: Apr 14 10:55:07 user devstack@n-api.service[61839]: request: DELETE /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/os-volume_attachments/08f71190-2402-402d-af67-edf9226e4fb8 HTTP/1.1 Apr 14 10:55:07 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:55:07 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:55:07 user devstack@n-api.service[61839]: Connection: close Apr 14 10:55:07 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:55:07 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:55:07 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:55:07 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:55:07 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:55:07 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS4ehvfPZmc6Cn8y_nUIgKmNt1MynNk1Jx9BkLUufz1O66F8ryB_RqLkjS4mqbIJCUIPkzgHXdvu3Dcwu4qkkSxSHHlhjBDdWlDUtyfTJIWQwoe_fVC9Grh5B2CbrOSLWshhTkM317x0-K8crYQxMYn74sVjwEj0iqM8tWzpqn1eQII Apr 14 10:55:07 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:55:07 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:55:07 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:55:07 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:55:07 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:55:07 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:55:07 user devstack@n-api.service[61839]: X-Project-Id: bf93e5dac50342d0b65ef09711401e99 Apr 14 10:55:07 user devstack@n-api.service[61839]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-563868574 Apr 14 10:55:07 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:55:07 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:55:07 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf93e5dac50342d0b65ef09711401e99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf93e5dac50342d0b65ef09711401e99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf93e5dac50342d0b65ef09711401e99"}]}] Apr 14 10:55:07 user devstack@n-api.service[61839]: X-Tenant: tempest-ServerRescueNegativeTestJSON-563868574 Apr 14 10:55:07 user devstack@n-api.service[61839]: X-Tenant-Id: bf93e5dac50342d0b65ef09711401e99 Apr 14 10:55:07 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-563868574 Apr 14 10:55:07 user devstack@n-api.service[61839]: X-User: tempest-ServerRescueNegativeTestJSON-563868574-project-member Apr 14 10:55:07 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:55:07 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:55:07 user devstack@n-api.service[61839]: X-User-Id: e359578dcbb24755a216415053d415ef Apr 14 10:55:07 user devstack@n-api.service[61839]: X-User-Name: tempest-ServerRescueNegativeTestJSON-563868574-project-member Apr 14 10:55:07 user devstack@n-api.service[61839]: method: > Apr 14 10:55:07 user devstack@n-api.service[61839]: exception: Cannot 'detach_volume' instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 while it is in vm_state rescued Apr 14 10:55:07 user devstack@n-api.service[61839]: action_args: {'server_id': 'd8e00388-b9f1-4c73-ad0a-3a1c8e0207d5', 'id': '08f71190-2402-402d-af67-edf9226e4fb8'} Apr 14 10:55:07 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 while it is in vm_state rescued Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 while it is in vm_state rescued Apr 14 10:55:07 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:55:07 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-9a8f2950-89a5-466d-ba3c-cdc9d595fd09 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Returning 409 to user: Cannot 'detach_volume' instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 while it is in vm_state rescued {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:55:07 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-9a8f2950-89a5-466d-ba3c-cdc9d595fd09 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/os-volume_attachments/08f71190-2402-402d-af67-edf9226e4fb8" status: 409 len: 152 microversion: 2.1 time: 0.107538 Apr 14 10:55:07 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 196/594] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:55:07 2023] DELETE /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/os-volume_attachments/08f71190-2402-402d-af67-edf9226e4fb8 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 10:55:07 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:07 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:07 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/action" status: 202 len: 0 microversion: 2.1 time: 0.075924 Apr 14 10:55:07 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 202/595] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:55:07 2023] POST /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:55:07 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-8fa7f114-5ae6-46d9-955d-1c790c61daf9 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:07 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-8fa7f114-5ae6-46d9-955d-1c790c61daf9 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:07 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8fa7f114-5ae6-46d9-955d-1c790c61daf9 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:07 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8fa7f114-5ae6-46d9-955d-1c790c61daf9 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:07 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8fa7f114-5ae6-46d9-955d-1c790c61daf9 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:07 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8fa7f114-5ae6-46d9-955d-1c790c61daf9 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:07 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8fa7f114-5ae6-46d9-955d-1c790c61daf9 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:07 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8fa7f114-5ae6-46d9-955d-1c790c61daf9 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:07 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-8eccecd8-53b4-4fe8-8a85-390abd3d3d6e req-78b8815b-fda0-40c5-a77d-ec85c7bc623d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8586a70e-9855-4177-ac1b-cf707a4df871", "name": "network-vif-plugged", "status": "completed", "tag": "473d9af8-25a0-4e5a-9afb-7a0c843115cc"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8eccecd8-53b4-4fe8-8a85-390abd3d3d6e req-78b8815b-fda0-40c5-a77d-ec85c7bc623d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8eccecd8-53b4-4fe8-8a85-390abd3d3d6e req-78b8815b-fda0-40c5-a77d-ec85c7bc623d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8eccecd8-53b4-4fe8-8a85-390abd3d3d6e req-78b8815b-fda0-40c5-a77d-ec85c7bc623d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:07 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-8eccecd8-53b4-4fe8-8a85-390abd3d3d6e req-78b8815b-fda0-40c5-a77d-ec85c7bc623d service nova] Creating event network-vif-plugged:473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance 8586a70e-9855-4177-ac1b-cf707a4df871 on user Apr 14 10:55:07 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-8eccecd8-53b4-4fe8-8a85-390abd3d3d6e req-78b8815b-fda0-40c5-a77d-ec85c7bc623d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031873 Apr 14 10:55:07 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 197/596] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:08 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-8fa7f114-5ae6-46d9-955d-1c790c61daf9 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:08 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-8fa7f114-5ae6-46d9-955d-1c790c61daf9 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" status: 200 len: 1711 microversion: 2.1 time: 0.514476 Apr 14 10:55:08 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 198/597] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:55:07 2023] GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => generated 1711 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:55:08 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-e5d003f8-7a02-49b2-a1ce-a0dccffb7bdb req-14fa95f3-f3d5-4509-94c1-5c1b5a8dd6bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f41f217-0df2-4205-9633-7dbe83f40c96", "tag": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:08 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e5d003f8-7a02-49b2-a1ce-a0dccffb7bdb req-14fa95f3-f3d5-4509-94c1-5c1b5a8dd6bd service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:08 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e5d003f8-7a02-49b2-a1ce-a0dccffb7bdb req-14fa95f3-f3d5-4509-94c1-5c1b5a8dd6bd service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:08 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e5d003f8-7a02-49b2-a1ce-a0dccffb7bdb req-14fa95f3-f3d5-4509-94c1-5c1b5a8dd6bd service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:08 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-e5d003f8-7a02-49b2-a1ce-a0dccffb7bdb req-14fa95f3-f3d5-4509-94c1-5c1b5a8dd6bd service nova] Creating event network-changed:e3d5b9ac-d641-478c-89cc-acbbf189ee2a for instance 6f41f217-0df2-4205-9633-7dbe83f40c96 on user Apr 14 10:55:08 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-e5d003f8-7a02-49b2-a1ce-a0dccffb7bdb req-14fa95f3-f3d5-4509-94c1-5c1b5a8dd6bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031912 Apr 14 10:55:08 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 203/598] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:09 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8586a70e-9855-4177-ac1b-cf707a4df871", "name": "network-vif-plugged", "status": "completed", "tag": "473d9af8-25a0-4e5a-9afb-7a0c843115cc"}, {"server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "name": "network-vif-unplugged", "status": "completed", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}, {"server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "name": "network-vif-plugged", "status": "completed", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:09 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:09 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:09 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:09 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Creating event network-vif-plugged:473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance 8586a70e-9855-4177-ac1b-cf707a4df871 on user Apr 14 10:55:09 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Creating event network-vif-unplugged:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:55:09 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Creating event network-vif-plugged:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:55:09 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.034330 Apr 14 10:55:09 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 198/599] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:09 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:10 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-11766470-e505-4a45-82a6-929637c6878b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:10 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-11766470-e505-4a45-82a6-929637c6878b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11766470-e505-4a45-82a6-929637c6878b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11766470-e505-4a45-82a6-929637c6878b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11766470-e505-4a45-82a6-929637c6878b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11766470-e505-4a45-82a6-929637c6878b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11766470-e505-4a45-82a6-929637c6878b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11766470-e505-4a45-82a6-929637c6878b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:10 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-11766470-e505-4a45-82a6-929637c6878b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.202465 Apr 14 10:55:10 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 199/600] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 10:55:10 2023] GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/os-interface => generated 282 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:55:11 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-2e7408e4-2402-4114-933d-7564ba39c27b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:11 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-2e7408e4-2402-4114-933d-7564ba39c27b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2e7408e4-2402-4114-933d-7564ba39c27b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2e7408e4-2402-4114-933d-7564ba39c27b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2e7408e4-2402-4114-933d-7564ba39c27b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2e7408e4-2402-4114-933d-7564ba39c27b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2e7408e4-2402-4114-933d-7564ba39c27b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2e7408e4-2402-4114-933d-7564ba39c27b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:11 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-2e7408e4-2402-4114-933d-7564ba39c27b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/ips" status: 200 len: 110 microversion: 2.20 time: 0.038937 Apr 14 10:55:11 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 204/601] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 10:55:11 2023] GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/ips => generated 110 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:55:12 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-69cecfa6-7e8d-48d4-9cf6-05ff22b29c0a req-83b41a83-a09d-4a10-9f03-812614f2dd63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387", "tag": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-69cecfa6-7e8d-48d4-9cf6-05ff22b29c0a req-83b41a83-a09d-4a10-9f03-812614f2dd63 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-69cecfa6-7e8d-48d4-9cf6-05ff22b29c0a req-83b41a83-a09d-4a10-9f03-812614f2dd63 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-69cecfa6-7e8d-48d4-9cf6-05ff22b29c0a req-83b41a83-a09d-4a10-9f03-812614f2dd63 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:12 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-69cecfa6-7e8d-48d4-9cf6-05ff22b29c0a req-83b41a83-a09d-4a10-9f03-812614f2dd63 service nova] Creating event network-changed:1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 on user Apr 14 10:55:12 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-69cecfa6-7e8d-48d4-9cf6-05ff22b29c0a req-83b41a83-a09d-4a10-9f03-812614f2dd63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087574 Apr 14 10:55:12 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 199/602] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:12 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-6552911a-7990-44fe-9802-eadc1815c836 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d1d3490>, body: {"keypair": {"name": "tempest-TestStampPattern-627373922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGJbZqWmfze/VbD7AiTXpBSSC7JeSqxVieDSB69GsDRbeWrzeiKDuD8IXa8m1YPGpwzOjCM3hxDW4Au2iAbXYcYId85Kh55qCn9eiY+V5K3AjDmmJpdlP7IQxGR6pVCIA=="}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:12 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-6552911a-7990-44fe-9802-eadc1815c836 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Getting quotas for project f629ba0ab8074ed8bb4e59d545b74eb6. Resources: {'key_pairs'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:55:12 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-6552911a-7990-44fe-9802-eadc1815c836 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Getting quotas for user e3ad6531a67b4be58a195e1208157b0b and project f629ba0ab8074ed8bb4e59d545b74eb6. Resources: {'key_pairs'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:55:12 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-6552911a-7990-44fe-9802-eadc1815c836 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.284922 Apr 14 10:55:12 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 200/603] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 10:55:12 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:13 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:13 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:13 user devstack@n-api.service[61841]: DEBUG nova.objects.instance [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'flavor' on Instance uuid fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 {{(pid=61841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:55:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "name": "network-vif-plugged", "status": "completed", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}, {"server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "name": "network-vif-plugged", "status": "completed", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}, {"server_uuid": "6f41f217-0df2-4205-9633-7dbe83f40c96", "name": "network-vif-plugged", "status": "completed", "tag": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a"}, {"server_uuid": "6f41f217-0df2-4205-9633-7dbe83f40c96", "name": "network-vif-plugged", "status": "completed", "tag": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Creating event network-vif-plugged:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:55:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Creating event network-vif-plugged:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:55:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Creating event network-vif-plugged:e3d5b9ac-d641-478c-89cc-acbbf189ee2a for instance 6f41f217-0df2-4205-9633-7dbe83f40c96 on user Apr 14 10:55:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Creating event network-vif-plugged:e3d5b9ac-d641-478c-89cc-acbbf189ee2a for instance 6f41f217-0df2-4205-9633-7dbe83f40c96 on user Apr 14 10:55:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.036358 Apr 14 10:55:14 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 200/604] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:14 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:55:14 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/action" status: 202 len: 0 microversion: 2.20 time: 0.909478 Apr 14 10:55:14 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 205/605] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 10:55:13 2023] POST /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/action => generated 0 bytes in 911 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:55:14 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-e5e05ee9-4947-4813-b683-657d6b07e1fd tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:14 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-e5e05ee9-4947-4813-b683-657d6b07e1fd tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:14 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e5e05ee9-4947-4813-b683-657d6b07e1fd tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e5e05ee9-4947-4813-b683-657d6b07e1fd tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e5e05ee9-4947-4813-b683-657d6b07e1fd tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e5e05ee9-4947-4813-b683-657d6b07e1fd tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e5e05ee9-4947-4813-b683-657d6b07e1fd tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e5e05ee9-4947-4813-b683-657d6b07e1fd tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:14 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-e5e05ee9-4947-4813-b683-657d6b07e1fd tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:14 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-e5e05ee9-4947-4813-b683-657d6b07e1fd tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:14 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-e5e05ee9-4947-4813-b683-657d6b07e1fd tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:14 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-e5e05ee9-4947-4813-b683-657d6b07e1fd tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" status: 200 len: 1711 microversion: 2.20 time: 0.265933 Apr 14 10:55:14 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 201/606] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:55:14 2023] GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => generated 1711 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:55:15 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-9a304502-a843-4c48-998b-9668d481b308 req-2a301011-1b4b-4f0d-a9bf-f685416d1637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387", "name": "network-vif-unplugged", "status": "completed", "tag": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9a304502-a843-4c48-998b-9668d481b308 req-2a301011-1b4b-4f0d-a9bf-f685416d1637 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9a304502-a843-4c48-998b-9668d481b308 req-2a301011-1b4b-4f0d-a9bf-f685416d1637 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9a304502-a843-4c48-998b-9668d481b308 req-2a301011-1b4b-4f0d-a9bf-f685416d1637 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:15 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-9a304502-a843-4c48-998b-9668d481b308 req-2a301011-1b4b-4f0d-a9bf-f685416d1637 service nova] Creating event network-vif-unplugged:1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 on user Apr 14 10:55:15 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-9a304502-a843-4c48-998b-9668d481b308 req-2a301011-1b4b-4f0d-a9bf-f685416d1637 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135178 Apr 14 10:55:15 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 201/607] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:16 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:16 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-6157528f-9d6d-4312-b7a4-dfa761f96b4b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:16 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-6157528f-9d6d-4312-b7a4-dfa761f96b4b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6157528f-9d6d-4312-b7a4-dfa761f96b4b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6157528f-9d6d-4312-b7a4-dfa761f96b4b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6157528f-9d6d-4312-b7a4-dfa761f96b4b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6157528f-9d6d-4312-b7a4-dfa761f96b4b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6157528f-9d6d-4312-b7a4-dfa761f96b4b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6157528f-9d6d-4312-b7a4-dfa761f96b4b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:16 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-6157528f-9d6d-4312-b7a4-dfa761f96b4b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.108275 Apr 14 10:55:16 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 206/608] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 10:55:16 2023] GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22/os-interface => generated 283 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:16 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1925914153", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "key_name": "tempest-TestStampPattern-627373922", "security_groups": [{"name": "tempest-secgroup-smoke-188727685"}], "networks": [{"uuid": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea"}]}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:17 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] validate_networks() for [('1fdeb048-706a-45bf-8f2a-2cee21abb9ea', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:55:17 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-2ef1c403-0ad0-4342-8647-fefde4988072 req-0afce026-759a-42ad-99e1-09bd9552e728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387", "name": "network-vif-plugged", "status": "completed", "tag": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2ef1c403-0ad0-4342-8647-fefde4988072 req-0afce026-759a-42ad-99e1-09bd9552e728 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2ef1c403-0ad0-4342-8647-fefde4988072 req-0afce026-759a-42ad-99e1-09bd9552e728 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2ef1c403-0ad0-4342-8647-fefde4988072 req-0afce026-759a-42ad-99e1-09bd9552e728 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:17 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-2ef1c403-0ad0-4342-8647-fefde4988072 req-0afce026-759a-42ad-99e1-09bd9552e728 service nova] Creating event network-vif-plugged:1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 on user Apr 14 10:55:17 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-2ef1c403-0ad0-4342-8647-fefde4988072 req-0afce026-759a-42ad-99e1-09bd9552e728 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047097 Apr 14 10:55:17 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 202/609] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:17 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:55:17 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:55:17 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:55:17 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:55:17 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Getting quotas for project f629ba0ab8074ed8bb4e59d545b74eb6. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Getting quotas for user e3ad6531a67b4be58a195e1208157b0b and project f629ba0ab8074ed8bb4e59d545b74eb6. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:55:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.357143 Apr 14 10:55:18 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 202/610] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:55:16 2023] POST /compute/v2.1/servers => generated 403 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:55:18 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-295d7b8c-75b4-4752-b07c-93f46487a26f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:18 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-295d7b8c-75b4-4752-b07c-93f46487a26f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:18 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-d7a58c1f-6472-430f-ba47-5686282d143e req-574728ec-26fe-40dc-b384-7c95abf294a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3393be13-7d81-48da-b6dd-a427e8403b22", "tag": "5c5720ce-d39a-4676-9116-0e5adf24d40f"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-d7a58c1f-6472-430f-ba47-5686282d143e req-574728ec-26fe-40dc-b384-7c95abf294a7 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-d7a58c1f-6472-430f-ba47-5686282d143e req-574728ec-26fe-40dc-b384-7c95abf294a7 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-d7a58c1f-6472-430f-ba47-5686282d143e req-574728ec-26fe-40dc-b384-7c95abf294a7 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:18 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-d7a58c1f-6472-430f-ba47-5686282d143e req-574728ec-26fe-40dc-b384-7c95abf294a7 service nova] Creating event network-changed:5c5720ce-d39a-4676-9116-0e5adf24d40f for instance 3393be13-7d81-48da-b6dd-a427e8403b22 on user Apr 14 10:55:18 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-d7a58c1f-6472-430f-ba47-5686282d143e req-574728ec-26fe-40dc-b384-7c95abf294a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034801 Apr 14 10:55:18 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 203/611] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-26fd4266-2487-4cca-9d00-72d054202563 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-26fd4266-2487-4cca-9d00-72d054202563 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-26fd4266-2487-4cca-9d00-72d054202563 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-26fd4266-2487-4cca-9d00-72d054202563 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-26fd4266-2487-4cca-9d00-72d054202563 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-26fd4266-2487-4cca-9d00-72d054202563 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-26fd4266-2487-4cca-9d00-72d054202563 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-26fd4266-2487-4cca-9d00-72d054202563 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:18 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-295d7b8c-75b4-4752-b07c-93f46487a26f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ad6531a67b4be58a195e1208157b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629ba0ab8074ed8bb4e59d545b74eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:18 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-295d7b8c-75b4-4752-b07c-93f46487a26f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe" status: 200 len: 1236 microversion: 2.1 time: 0.125668 Apr 14 10:55:18 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 207/612] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:55:18 2023] GET /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe => generated 1236 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:55:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-26fd4266-2487-4cca-9d00-72d054202563 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22/ips" status: 200 len: 109 microversion: 2.1 time: 0.060680 Apr 14 10:55:18 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 203/613] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 10:55:18 2023] GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22/ips => generated 109 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:18 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-d16fd5c7-37c4-4251-923c-40b5337d41aa tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e52b9d6a-ee3e-42b8-973e-d47c4ed33196"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:18 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-d16fd5c7-37c4-4251-923c-40b5337d41aa tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d16fd5c7-37c4-4251-923c-40b5337d41aa tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d16fd5c7-37c4-4251-923c-40b5337d41aa tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d16fd5c7-37c4-4251-923c-40b5337d41aa tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d16fd5c7-37c4-4251-923c-40b5337d41aa tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d16fd5c7-37c4-4251-923c-40b5337d41aa tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d16fd5c7-37c4-4251-923c-40b5337d41aa tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:18 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-d16fd5c7-37c4-4251-923c-40b5337d41aa tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HTTP exception thrown: Invalid volume: volume e52b9d6a-ee3e-42b8-973e-d47c4ed33196 is already attached to instances: cd661ae0-c4bb-4117-847d-ef7e85d062fb Apr 14 10:55:18 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-d16fd5c7-37c4-4251-923c-40b5337d41aa tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Request method failure captured: Apr 14 10:55:18 user devstack@n-api.service[61839]: request: POST /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22/os-volume_attachments HTTP/1.1 Apr 14 10:55:18 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:55:18 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:55:18 user devstack@n-api.service[61839]: Connection: close Apr 14 10:55:18 user devstack@n-api.service[61839]: Content-Length: 74 Apr 14 10:55:18 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:55:18 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:55:18 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:55:18 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:55:18 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTAm6v8qUESI0IjizmIjmsJWXGLOjjeSrv09ri2T6RAbvAYajYyIrxw22PgYPfP-sFhLjBYVsJQMKmp7KoYSOSHZjTqklYHtEK1WW90dx3jL-AC6Ab0TV_VkQ0gzFfhCxphVnwf0RVdI8bvNKr-C_80J359JrotPIMB_M0XXXvYIzcQ Apr 14 10:55:18 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:55:18 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:55:18 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:55:18 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:55:18 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:55:18 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:55:18 user devstack@n-api.service[61839]: X-Project-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 10:55:18 user devstack@n-api.service[61839]: X-Project-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 10:55:18 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:55:18 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:55:18 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}] Apr 14 10:55:18 user devstack@n-api.service[61839]: X-Tenant: tempest-AttachVolumeNegativeTest-531644967 Apr 14 10:55:18 user devstack@n-api.service[61839]: X-Tenant-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 10:55:18 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 10:55:18 user devstack@n-api.service[61839]: X-User: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 10:55:18 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:55:18 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:55:18 user devstack@n-api.service[61839]: X-User-Id: 78adbbdcd10e446daddde754e46309b2 Apr 14 10:55:18 user devstack@n-api.service[61839]: X-User-Name: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 10:55:18 user devstack@n-api.service[61839]: Apr 14 10:55:18 user devstack@n-api.service[61839]: {"volumeAttachment": {"volumeId": "e52b9d6a-ee3e-42b8-973e-d47c4ed33196"}} Apr 14 10:55:18 user devstack@n-api.service[61839]: method: > Apr 14 10:55:18 user devstack@n-api.service[61839]: exception: Invalid volume: volume e52b9d6a-ee3e-42b8-973e-d47c4ed33196 is already attached to instances: cd661ae0-c4bb-4117-847d-ef7e85d062fb Apr 14 10:55:18 user devstack@n-api.service[61839]: action_args: {'server_id': '3393be13-7d81-48da-b6dd-a427e8403b22', 'body': {'volumeAttachment': {'volumeId': 'e52b9d6a-ee3e-42b8-973e-d47c4ed33196'}}} Apr 14 10:55:18 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e52b9d6a-ee3e-42b8-973e-d47c4ed33196 is already attached to instances: cd661ae0-c4bb-4117-847d-ef7e85d062fb Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e52b9d6a-ee3e-42b8-973e-d47c4ed33196 is already attached to instances: cd661ae0-c4bb-4117-847d-ef7e85d062fb Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e52b9d6a-ee3e-42b8-973e-d47c4ed33196 is already attached to instances: cd661ae0-c4bb-4117-847d-ef7e85d062fb Apr 14 10:55:18 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:55:18 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-d16fd5c7-37c4-4251-923c-40b5337d41aa tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Returning 400 to user: Invalid volume: volume e52b9d6a-ee3e-42b8-973e-d47c4ed33196 is already attached to instances: cd661ae0-c4bb-4117-847d-ef7e85d062fb {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:55:18 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-d16fd5c7-37c4-4251-923c-40b5337d41aa tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.137035 Apr 14 10:55:18 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 204/614] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:55:18 2023] POST /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22/os-volume_attachments => generated 174 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:55:18 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:18 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:18 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:55:18 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22" status: 204 len: 0 microversion: 2.1 time: 0.139577 Apr 14 10:55:18 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 208/615] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:55:18 2023] DELETE /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-1042a803-a36a-4ea9-b431-2270f619be13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-1042a803-a36a-4ea9-b431-2270f619be13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1042a803-a36a-4ea9-b431-2270f619be13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1042a803-a36a-4ea9-b431-2270f619be13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1042a803-a36a-4ea9-b431-2270f619be13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1042a803-a36a-4ea9-b431-2270f619be13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1042a803-a36a-4ea9-b431-2270f619be13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1042a803-a36a-4ea9-b431-2270f619be13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:18 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-1042a803-a36a-4ea9-b431-2270f619be13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-1042a803-a36a-4ea9-b431-2270f619be13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22" status: 200 len: 1552 microversion: 2.1 time: 0.252036 Apr 14 10:55:18 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 204/616] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:55:18 2023] GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22 => generated 1552 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:55:19 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3393be13-7d81-48da-b6dd-a427e8403b22", "name": "network-vif-unplugged", "status": "completed", "tag": "5c5720ce-d39a-4676-9116-0e5adf24d40f"}, {"server_uuid": "3393be13-7d81-48da-b6dd-a427e8403b22", "name": "network-vif-plugged", "status": "completed", "tag": "5c5720ce-d39a-4676-9116-0e5adf24d40f"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:19 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:19 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] Creating event network-vif-unplugged:5c5720ce-d39a-4676-9116-0e5adf24d40f for instance 3393be13-7d81-48da-b6dd-a427e8403b22 on user Apr 14 10:55:19 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] Creating event network-vif-plugged:5c5720ce-d39a-4676-9116-0e5adf24d40f for instance 3393be13-7d81-48da-b6dd-a427e8403b22 on user Apr 14 10:55:19 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.066910 Apr 14 10:55:19 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 205/617] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:19 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:55:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-63d74773-5f4b-4271-9787-e007f5b0ad01 req-fed76f29-4904-4dba-8f42-4d1dddf47eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3393be13-7d81-48da-b6dd-a427e8403b22", "name": "network-vif-deleted", "tag": "5c5720ce-d39a-4676-9116-0e5adf24d40f"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-63d74773-5f4b-4271-9787-e007f5b0ad01 req-fed76f29-4904-4dba-8f42-4d1dddf47eed service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-63d74773-5f4b-4271-9787-e007f5b0ad01 req-fed76f29-4904-4dba-8f42-4d1dddf47eed service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-63d74773-5f4b-4271-9787-e007f5b0ad01 req-fed76f29-4904-4dba-8f42-4d1dddf47eed service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:21 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-63d74773-5f4b-4271-9787-e007f5b0ad01 req-fed76f29-4904-4dba-8f42-4d1dddf47eed service nova] Creating event network-vif-deleted:5c5720ce-d39a-4676-9116-0e5adf24d40f for instance 3393be13-7d81-48da-b6dd-a427e8403b22 on user Apr 14 10:55:21 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-63d74773-5f4b-4271-9787-e007f5b0ad01 req-fed76f29-4904-4dba-8f42-4d1dddf47eed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037024 Apr 14 10:55:21 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 209/618] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-3c473a8f-8cd0-4de3-a8fb-a05b875c2c5f req-8d1a0c7c-2589-41a4-a6d8-89ccf340483c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6580716-8a6a-4dfa-8978-ed54b92af1fe", "tag": "3019f976-f679-4826-8510-3de34b67807c"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-3c473a8f-8cd0-4de3-a8fb-a05b875c2c5f req-8d1a0c7c-2589-41a4-a6d8-89ccf340483c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-3c473a8f-8cd0-4de3-a8fb-a05b875c2c5f req-8d1a0c7c-2589-41a4-a6d8-89ccf340483c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-3c473a8f-8cd0-4de3-a8fb-a05b875c2c5f req-8d1a0c7c-2589-41a4-a6d8-89ccf340483c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:22 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-3c473a8f-8cd0-4de3-a8fb-a05b875c2c5f req-8d1a0c7c-2589-41a4-a6d8-89ccf340483c service nova] Creating event network-changed:3019f976-f679-4826-8510-3de34b67807c for instance e6580716-8a6a-4dfa-8978-ed54b92af1fe on user Apr 14 10:55:22 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-3c473a8f-8cd0-4de3-a8fb-a05b875c2c5f req-8d1a0c7c-2589-41a4-a6d8-89ccf340483c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037635 Apr 14 10:55:22 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 205/619] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-a7e50592-61c2-402d-9459-8b17a01a08d3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:22 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-a7e50592-61c2-402d-9459-8b17a01a08d3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a7e50592-61c2-402d-9459-8b17a01a08d3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a7e50592-61c2-402d-9459-8b17a01a08d3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a7e50592-61c2-402d-9459-8b17a01a08d3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a7e50592-61c2-402d-9459-8b17a01a08d3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a7e50592-61c2-402d-9459-8b17a01a08d3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a7e50592-61c2-402d-9459-8b17a01a08d3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:23 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-a7e50592-61c2-402d-9459-8b17a01a08d3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:23 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-a7e50592-61c2-402d-9459-8b17a01a08d3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1722 microversion: 2.1 time: 0.241810 Apr 14 10:55:23 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 206/620] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:55:22 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:55:23 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-6d22bdc2-8901-4738-a89f-236fbad5a9d6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:23 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-6d22bdc2-8901-4738-a89f-236fbad5a9d6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6d22bdc2-8901-4738-a89f-236fbad5a9d6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6d22bdc2-8901-4738-a89f-236fbad5a9d6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6d22bdc2-8901-4738-a89f-236fbad5a9d6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6d22bdc2-8901-4738-a89f-236fbad5a9d6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6d22bdc2-8901-4738-a89f-236fbad5a9d6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6d22bdc2-8901-4738-a89f-236fbad5a9d6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:23 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-6d22bdc2-8901-4738-a89f-236fbad5a9d6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:23 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-6d22bdc2-8901-4738-a89f-236fbad5a9d6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1722 microversion: 2.1 time: 0.187770 Apr 14 10:55:23 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 210/621] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:55:23 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:55:23 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-cafdd13f-d2bf-4a4d-a575-4c4b319cd4c9 req-4caad24e-41df-4ead-90fa-63c3d1194c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387", "tag": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:23 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-cafdd13f-d2bf-4a4d-a575-4c4b319cd4c9 req-4caad24e-41df-4ead-90fa-63c3d1194c97 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:23 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-cafdd13f-d2bf-4a4d-a575-4c4b319cd4c9 req-4caad24e-41df-4ead-90fa-63c3d1194c97 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:23 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-cafdd13f-d2bf-4a4d-a575-4c4b319cd4c9 req-4caad24e-41df-4ead-90fa-63c3d1194c97 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:23 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.compute.server_external_events [req-cafdd13f-d2bf-4a4d-a575-4c4b319cd4c9 req-4caad24e-41df-4ead-90fa-63c3d1194c97 service nova] Unable to find a host for instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387. Dropping event network-changed {{(pid=61840) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 14 10:55:23 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-cafdd13f-d2bf-4a4d-a575-4c4b319cd4c9 req-4caad24e-41df-4ead-90fa-63c3d1194c97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 176 microversion: 2.1 time: 0.040273 Apr 14 10:55:23 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 206/622] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:23 2023] POST /compute/v2.1/os-server-external-events => generated 176 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 14 10:55:25 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6580716-8a6a-4dfa-8978-ed54b92af1fe", "name": "network-vif-plugged", "status": "completed", "tag": "3019f976-f679-4826-8510-3de34b67807c"}, {"server_uuid": "e6580716-8a6a-4dfa-8978-ed54b92af1fe", "name": "network-vif-plugged", "status": "completed", "tag": "3019f976-f679-4826-8510-3de34b67807c"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:25 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] Creating event network-vif-plugged:3019f976-f679-4826-8510-3de34b67807c for instance e6580716-8a6a-4dfa-8978-ed54b92af1fe on user Apr 14 10:55:25 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] Creating event network-vif-plugged:3019f976-f679-4826-8510-3de34b67807c for instance e6580716-8a6a-4dfa-8978-ed54b92af1fe on user Apr 14 10:55:25 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029477 Apr 14 10:55:25 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 207/623] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:50 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-116763620", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "networks": [{"uuid": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8"}]}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:50 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:50 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:50 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:50 user devstack@n-api.service[61841]: DEBUG nova.network.neutron [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] validate_networks() for [('07f1f39e-292a-4e73-b4ed-99e5799d6fa8', None, None, None, None, None)] {{(pid=61841) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:55:51 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:55:51 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:55:51 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:55:51 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:55:51 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:55:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:51 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting quotas for project 71289f80a05141f482cb538dac3d7b38. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:55:51 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting quotas for user 395bc9d7007c4e01ac7effd418bcea19 and project 71289f80a05141f482cb538dac3d7b38. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:55:51 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Going to run 1 instances... {{(pid=61841) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:55:51 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61841) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:55:51 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.678619 Apr 14 10:55:51 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 211/624] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 10:55:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 10:55:51 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-7e49bc50-0969-4cfb-8dcc-5823cd2b8144 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:51 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-7e49bc50-0969-4cfb-8dcc-5823cd2b8144 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:51 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:51 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=16 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:51 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=7 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:51 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=40 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:51 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-7e49bc50-0969-4cfb-8dcc-5823cd2b8144 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:51 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-7e49bc50-0969-4cfb-8dcc-5823cd2b8144 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:51 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-7e49bc50-0969-4cfb-8dcc-5823cd2b8144 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:51 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-7e49bc50-0969-4cfb-8dcc-5823cd2b8144 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a936fb20-3f17-4114-829a-8659da6bc5f3" status: 200 len: 1394 microversion: 2.87 time: 0.322531 Apr 14 10:55:51 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 207/625] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:55:51 2023] GET /compute/v2.1/servers/a936fb20-3f17-4114-829a-8659da6bc5f3 => generated 1394 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:55:53 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=26 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:53 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:55:53 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-9311ecfa-1625-4780-a5bd-9580829f0334 req-0461eafd-eadc-4495-a058-07d825e6721f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a936fb20-3f17-4114-829a-8659da6bc5f3", "tag": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9311ecfa-1625-4780-a5bd-9580829f0334 req-0461eafd-eadc-4495-a058-07d825e6721f service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9311ecfa-1625-4780-a5bd-9580829f0334 req-0461eafd-eadc-4495-a058-07d825e6721f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9311ecfa-1625-4780-a5bd-9580829f0334 req-0461eafd-eadc-4495-a058-07d825e6721f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:53 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-9311ecfa-1625-4780-a5bd-9580829f0334 req-0461eafd-eadc-4495-a058-07d825e6721f service nova] Creating event network-changed:472fc537-2bff-4ebb-bfb7-f7973f9f8b81 for instance a936fb20-3f17-4114-829a-8659da6bc5f3 on user Apr 14 10:55:54 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-9311ecfa-1625-4780-a5bd-9580829f0334 req-0461eafd-eadc-4495-a058-07d825e6721f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044819 Apr 14 10:55:54 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 208/626] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:55 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-239ec9de-cdda-4174-87d9-4b52b020ec7c tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:55 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-239ec9de-cdda-4174-87d9-4b52b020ec7c tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-239ec9de-cdda-4174-87d9-4b52b020ec7c tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-239ec9de-cdda-4174-87d9-4b52b020ec7c tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-239ec9de-cdda-4174-87d9-4b52b020ec7c tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-239ec9de-cdda-4174-87d9-4b52b020ec7c tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-239ec9de-cdda-4174-87d9-4b52b020ec7c tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-239ec9de-cdda-4174-87d9-4b52b020ec7c tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:55 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-239ec9de-cdda-4174-87d9-4b52b020ec7c tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f2157c5d4d441db80ea4a3ca60e4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1c0764b8a843808158644eb90704e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:55 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-239ec9de-cdda-4174-87d9-4b52b020ec7c tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96" status: 200 len: 1495 microversion: 2.1 time: 0.141553 Apr 14 10:55:55 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 212/627] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:55:55 2023] GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96 => generated 1495 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:55:55 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-c9fb6bda-2e78-4123-99cf-5a252fc09e59 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:55 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-c9fb6bda-2e78-4123-99cf-5a252fc09e59 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c9fb6bda-2e78-4123-99cf-5a252fc09e59 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c9fb6bda-2e78-4123-99cf-5a252fc09e59 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c9fb6bda-2e78-4123-99cf-5a252fc09e59 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c9fb6bda-2e78-4123-99cf-5a252fc09e59 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c9fb6bda-2e78-4123-99cf-5a252fc09e59 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c9fb6bda-2e78-4123-99cf-5a252fc09e59 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:55 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-c9fb6bda-2e78-4123-99cf-5a252fc09e59 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:55 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-c9fb6bda-2e78-4123-99cf-5a252fc09e59 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871" status: 200 len: 1654 microversion: 2.1 time: 0.183906 Apr 14 10:55:55 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 208/628] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:55:55 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 => generated 1654 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:55:56 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-b9ca0add-2b37-4677-9c0b-d2eabe9f4da0 req-c945eb7d-4913-4506-84e8-46205d8b46ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a936fb20-3f17-4114-829a-8659da6bc5f3", "name": "network-vif-plugged", "status": "completed", "tag": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-b9ca0add-2b37-4677-9c0b-d2eabe9f4da0 req-c945eb7d-4913-4506-84e8-46205d8b46ca service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-b9ca0add-2b37-4677-9c0b-d2eabe9f4da0 req-c945eb7d-4913-4506-84e8-46205d8b46ca service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-b9ca0add-2b37-4677-9c0b-d2eabe9f4da0 req-c945eb7d-4913-4506-84e8-46205d8b46ca service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:56 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-b9ca0add-2b37-4677-9c0b-d2eabe9f4da0 req-c945eb7d-4913-4506-84e8-46205d8b46ca service nova] Creating event network-vif-plugged:472fc537-2bff-4ebb-bfb7-f7973f9f8b81 for instance a936fb20-3f17-4114-829a-8659da6bc5f3 on user Apr 14 10:55:56 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-b9ca0add-2b37-4677-9c0b-d2eabe9f4da0 req-c945eb7d-4913-4506-84e8-46205d8b46ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040144 Apr 14 10:55:56 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 209/629] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:58 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-c323fb2c-5248-4fe3-9e84-9118ff3264f7 req-f34a0673-9dbf-4a52-aa4c-a239c5e45e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a936fb20-3f17-4114-829a-8659da6bc5f3", "name": "network-vif-plugged", "status": "completed", "tag": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:55:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-c323fb2c-5248-4fe3-9e84-9118ff3264f7 req-f34a0673-9dbf-4a52-aa4c-a239c5e45e47 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-c323fb2c-5248-4fe3-9e84-9118ff3264f7 req-f34a0673-9dbf-4a52-aa4c-a239c5e45e47 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-c323fb2c-5248-4fe3-9e84-9118ff3264f7 req-f34a0673-9dbf-4a52-aa4c-a239c5e45e47 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:58 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-c323fb2c-5248-4fe3-9e84-9118ff3264f7 req-f34a0673-9dbf-4a52-aa4c-a239c5e45e47 service nova] Creating event network-vif-plugged:472fc537-2bff-4ebb-bfb7-f7973f9f8b81 for instance a936fb20-3f17-4114-829a-8659da6bc5f3 on user Apr 14 10:55:58 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-c323fb2c-5248-4fe3-9e84-9118ff3264f7 req-f34a0673-9dbf-4a52-aa4c-a239c5e45e47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034062 Apr 14 10:55:58 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 213/630] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:55:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:55:58 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-f6641a20-7740-447c-8d13-befde54cfae6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:55:58 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-f6641a20-7740-447c-8d13-befde54cfae6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:55:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f6641a20-7740-447c-8d13-befde54cfae6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f6641a20-7740-447c-8d13-befde54cfae6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f6641a20-7740-447c-8d13-befde54cfae6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f6641a20-7740-447c-8d13-befde54cfae6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:55:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f6641a20-7740-447c-8d13-befde54cfae6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:55:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f6641a20-7740-447c-8d13-befde54cfae6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:55:58 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-f6641a20-7740-447c-8d13-befde54cfae6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:55:58 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-f6641a20-7740-447c-8d13-befde54cfae6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" status: 200 len: 1717 microversion: 2.1 time: 0.155392 Apr 14 10:55:58 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 209/631] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:55:58 2023] GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:56:05 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-55b8a241-8cdb-4a68-8282-73fa2bbe0336 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:05 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-55b8a241-8cdb-4a68-8282-73fa2bbe0336 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:56:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-55b8a241-8cdb-4a68-8282-73fa2bbe0336 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-55b8a241-8cdb-4a68-8282-73fa2bbe0336 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-55b8a241-8cdb-4a68-8282-73fa2bbe0336 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-55b8a241-8cdb-4a68-8282-73fa2bbe0336 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-55b8a241-8cdb-4a68-8282-73fa2bbe0336 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-55b8a241-8cdb-4a68-8282-73fa2bbe0336 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:05 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-55b8a241-8cdb-4a68-8282-73fa2bbe0336 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:56:05 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-55b8a241-8cdb-4a68-8282-73fa2bbe0336 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:56:05 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-55b8a241-8cdb-4a68-8282-73fa2bbe0336 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:56:05 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-55b8a241-8cdb-4a68-8282-73fa2bbe0336 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" status: 200 len: 1652 microversion: 2.20 time: 0.153866 Apr 14 10:56:05 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 210/632] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:56:05 2023] GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => generated 1652 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:56:08 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:08 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:08 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:08 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=10 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:08 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-5a0ebea3-6dde-427f-9c81-29de66d84690 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:08 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-5a0ebea3-6dde-427f-9c81-29de66d84690 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:56:08 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5a0ebea3-6dde-427f-9c81-29de66d84690 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:08 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5a0ebea3-6dde-427f-9c81-29de66d84690 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:08 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5a0ebea3-6dde-427f-9c81-29de66d84690 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:08 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5a0ebea3-6dde-427f-9c81-29de66d84690 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:08 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5a0ebea3-6dde-427f-9c81-29de66d84690 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:08 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5a0ebea3-6dde-427f-9c81-29de66d84690 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:08 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-5a0ebea3-6dde-427f-9c81-29de66d84690 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ad6531a67b4be58a195e1208157b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629ba0ab8074ed8bb4e59d545b74eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:56:08 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-5a0ebea3-6dde-427f-9c81-29de66d84690 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe" status: 200 len: 1538 microversion: 2.1 time: 0.170173 Apr 14 10:56:08 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 214/633] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:56:08 2023] GET /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe => generated 1538 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:56:08 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-6b6f4d4d-6cd4-489f-9a3c-13a2aeb3bf26 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:08 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-6b6f4d4d-6cd4-489f-9a3c-13a2aeb3bf26 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:56:08 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:08 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=10 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:08 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=12 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6b6f4d4d-6cd4-489f-9a3c-13a2aeb3bf26 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6b6f4d4d-6cd4-489f-9a3c-13a2aeb3bf26 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6b6f4d4d-6cd4-489f-9a3c-13a2aeb3bf26 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6b6f4d4d-6cd4-489f-9a3c-13a2aeb3bf26 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6b6f4d4d-6cd4-489f-9a3c-13a2aeb3bf26 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-6b6f4d4d-6cd4-489f-9a3c-13a2aeb3bf26 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:08 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-6b6f4d4d-6cd4-489f-9a3c-13a2aeb3bf26 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HTTP exception thrown: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. Apr 14 10:56:08 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-6b6f4d4d-6cd4-489f-9a3c-13a2aeb3bf26 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Request method failure captured: Apr 14 10:56:08 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22 HTTP/1.1 Apr 14 10:56:08 user devstack@n-api.service[61840]: Accept: application/json Apr 14 10:56:08 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 10:56:08 user devstack@n-api.service[61840]: Connection: close Apr 14 10:56:08 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 10:56:08 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 10:56:08 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 10:56:08 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 10:56:08 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 10:56:08 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTAm6v8qUESI0IjizmIjmsJWXGLOjjeSrv09ri2T6RAbvAYajYyIrxw22PgYPfP-sFhLjBYVsJQMKmp7KoYSOSHZjTqklYHtEK1WW90dx3jL-AC6Ab0TV_VkQ0gzFfhCxphVnwf0RVdI8bvNKr-C_80J359JrotPIMB_M0XXXvYIzcQ Apr 14 10:56:08 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 10:56:08 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 10:56:08 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 10:56:08 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 10:56:08 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 10:56:08 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 10:56:08 user devstack@n-api.service[61840]: X-Project-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 10:56:08 user devstack@n-api.service[61840]: X-Project-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 10:56:08 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 10:56:08 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 10:56:08 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}] Apr 14 10:56:08 user devstack@n-api.service[61840]: X-Tenant: tempest-AttachVolumeNegativeTest-531644967 Apr 14 10:56:08 user devstack@n-api.service[61840]: X-Tenant-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 10:56:08 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 10:56:08 user devstack@n-api.service[61840]: X-User: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 10:56:08 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 10:56:08 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 10:56:08 user devstack@n-api.service[61840]: X-User-Id: 78adbbdcd10e446daddde754e46309b2 Apr 14 10:56:08 user devstack@n-api.service[61840]: X-User-Name: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 10:56:08 user devstack@n-api.service[61840]: method: > Apr 14 10:56:08 user devstack@n-api.service[61840]: exception: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. Apr 14 10:56:08 user devstack@n-api.service[61840]: action_args: {'id': '3393be13-7d81-48da-b6dd-a427e8403b22'} Apr 14 10:56:08 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. Apr 14 10:56:08 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:56:08 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-6b6f4d4d-6cd4-489f-9a3c-13a2aeb3bf26 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Returning 404 to user: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:56:08 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-6b6f4d4d-6cd4-489f-9a3c-13a2aeb3bf26 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22" status: 404 len: 111 microversion: 2.1 time: 0.033440 Apr 14 10:56:08 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 210/634] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:56:08 2023] GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:56:08 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-74e2391d-68b0-4a6e-8a75-be13aa207813 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '.version_select at 0x7fcd1ceeb7f0>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:08 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-74e2391d-68b0-4a6e-8a75-be13aa207813 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-160863978" status: 202 len: 0 microversion: 2.1 time: 0.026470 Apr 14 10:56:08 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 211/635] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 10:56:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-160863978 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:56:09 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:09 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:56:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:09 user devstack@n-api.service[61841]: DEBUG nova.objects.instance [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'services' on Instance uuid cd661ae0-c4bb-4117-847d-ef7e85d062fb {{(pid=61841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:56:10 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb/os-volume_attachments/e52b9d6a-ee3e-42b8-973e-d47c4ed33196" status: 202 len: 0 microversion: 2.1 time: 0.223212 Apr 14 10:56:10 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 215/636] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:56:09 2023] DELETE /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb/os-volume_attachments/e52b9d6a-ee3e-42b8-973e-d47c4ed33196 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:56:10 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-59480423-4a09-4409-af17-3171364f1f49 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:10 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-59480423-4a09-4409-af17-3171364f1f49 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:56:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-59480423-4a09-4409-af17-3171364f1f49 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-59480423-4a09-4409-af17-3171364f1f49 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-59480423-4a09-4409-af17-3171364f1f49 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-59480423-4a09-4409-af17-3171364f1f49 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-59480423-4a09-4409-af17-3171364f1f49 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-59480423-4a09-4409-af17-3171364f1f49 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:10 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-59480423-4a09-4409-af17-3171364f1f49 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088168 Apr 14 10:56:10 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 211/637] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:56:10 2023] GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:56:23 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=10 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:23 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:23 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:23 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:56:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:23 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:56:23 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 204 len: 0 microversion: 2.1 time: 0.130424 Apr 14 10:56:23 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 212/638] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:56:23 2023] DELETE /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:56:23 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:23 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:23 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-d9333f24-4b43-4096-be29-7ce4d891f869 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:23 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-d9333f24-4b43-4096-be29-7ce4d891f869 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:56:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d9333f24-4b43-4096-be29-7ce4d891f869 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d9333f24-4b43-4096-be29-7ce4d891f869 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d9333f24-4b43-4096-be29-7ce4d891f869 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d9333f24-4b43-4096-be29-7ce4d891f869 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d9333f24-4b43-4096-be29-7ce4d891f869 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:23 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d9333f24-4b43-4096-be29-7ce4d891f869 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:23 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-d9333f24-4b43-4096-be29-7ce4d891f869 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:56:23 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-d9333f24-4b43-4096-be29-7ce4d891f869 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 200 len: 1728 microversion: 2.1 time: 0.207430 Apr 14 10:56:23 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 216/639] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:56:23 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 1728 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:56:23 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-581de955-9868-422e-8b3c-e4cfeb79bc52 req-e41b79f4-ff80-48d4-84fb-de94e84d335c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-unplugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:56:23 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:23 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=8 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:23 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-581de955-9868-422e-8b3c-e4cfeb79bc52 req-e41b79f4-ff80-48d4-84fb-de94e84d335c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:23 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-581de955-9868-422e-8b3c-e4cfeb79bc52 req-e41b79f4-ff80-48d4-84fb-de94e84d335c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:23 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-581de955-9868-422e-8b3c-e4cfeb79bc52 req-e41b79f4-ff80-48d4-84fb-de94e84d335c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:23 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-581de955-9868-422e-8b3c-e4cfeb79bc52 req-e41b79f4-ff80-48d4-84fb-de94e84d335c service nova] Creating event network-vif-unplugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:56:23 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-581de955-9868-422e-8b3c-e4cfeb79bc52 req-e41b79f4-ff80-48d4-84fb-de94e84d335c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047867 Apr 14 10:56:23 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 212/640] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:56:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:56:25 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-7b5ddec3-b0ba-4682-b168-be189b93ccc7 req-fe528e78-6da6-428c-bd7a-8e11b57b69a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-deleted", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:56:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-7b5ddec3-b0ba-4682-b168-be189b93ccc7 req-fe528e78-6da6-428c-bd7a-8e11b57b69a0 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-7b5ddec3-b0ba-4682-b168-be189b93ccc7 req-fe528e78-6da6-428c-bd7a-8e11b57b69a0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-7b5ddec3-b0ba-4682-b168-be189b93ccc7 req-fe528e78-6da6-428c-bd7a-8e11b57b69a0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:25 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-7b5ddec3-b0ba-4682-b168-be189b93ccc7 req-fe528e78-6da6-428c-bd7a-8e11b57b69a0 service nova] Creating event network-vif-deleted:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:56:25 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-7b5ddec3-b0ba-4682-b168-be189b93ccc7 req-fe528e78-6da6-428c-bd7a-8e11b57b69a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038372 Apr 14 10:56:25 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 213/641] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:56:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:56:25 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-cc3712c3-e50f-416b-b947-17a189a0c7c5 req-173b7305-61d1-4624-a542-2d2842b25762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4abb549-8f36-40c5-971f-8accbb14ff86", "name": "network-vif-plugged", "status": "completed", "tag": "608a2408-02df-474f-9006-260c8c97def1"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:56:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-cc3712c3-e50f-416b-b947-17a189a0c7c5 req-173b7305-61d1-4624-a542-2d2842b25762 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-cc3712c3-e50f-416b-b947-17a189a0c7c5 req-173b7305-61d1-4624-a542-2d2842b25762 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:25 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-cc3712c3-e50f-416b-b947-17a189a0c7c5 req-173b7305-61d1-4624-a542-2d2842b25762 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:25 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-cc3712c3-e50f-416b-b947-17a189a0c7c5 req-173b7305-61d1-4624-a542-2d2842b25762 service nova] Creating event network-vif-plugged:608a2408-02df-474f-9006-260c8c97def1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 on user Apr 14 10:56:25 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-cc3712c3-e50f-416b-b947-17a189a0c7c5 req-173b7305-61d1-4624-a542-2d2842b25762 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030623 Apr 14 10:56:25 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 217/642] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:56:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:56:41 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:41 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:41 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ebbf7e9e-4882-4f2e-b14b-fdfe9eed73de tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:41 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-ebbf7e9e-4882-4f2e-b14b-fdfe9eed73de tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:56:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ebbf7e9e-4882-4f2e-b14b-fdfe9eed73de tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ebbf7e9e-4882-4f2e-b14b-fdfe9eed73de tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ebbf7e9e-4882-4f2e-b14b-fdfe9eed73de tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ebbf7e9e-4882-4f2e-b14b-fdfe9eed73de tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ebbf7e9e-4882-4f2e-b14b-fdfe9eed73de tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ebbf7e9e-4882-4f2e-b14b-fdfe9eed73de tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:41 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-ebbf7e9e-4882-4f2e-b14b-fdfe9eed73de tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:56:41 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-ebbf7e9e-4882-4f2e-b14b-fdfe9eed73de tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:56:41 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-ebbf7e9e-4882-4f2e-b14b-fdfe9eed73de tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:56:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-ebbf7e9e-4882-4f2e-b14b-fdfe9eed73de tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a936fb20-3f17-4114-829a-8659da6bc5f3" status: 200 len: 1690 microversion: 2.87 time: 0.185299 Apr 14 10:56:41 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 213/643] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:56:41 2023] GET /compute/v2.1/servers/a936fb20-3f17-4114-829a-8659da6bc5f3 => generated 1690 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-810949699", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "networks": [{"uuid": "0d829782-2ea4-4af3-8460-468b818423dc"}]}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] validate_networks() for [('0d829782-2ea4-4af3-8460-468b818423dc', None, None, None, None, None)] {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=8 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-42418206-9558-4d33-a9a3-8619d87f587f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-42418206-9558-4d33-a9a3-8619d87f587f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42418206-9558-4d33-a9a3-8619d87f587f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42418206-9558-4d33-a9a3-8619d87f587f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42418206-9558-4d33-a9a3-8619d87f587f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42418206-9558-4d33-a9a3-8619d87f587f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42418206-9558-4d33-a9a3-8619d87f587f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-42418206-9558-4d33-a9a3-8619d87f587f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:55 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-42418206-9558-4d33-a9a3-8619d87f587f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053407 Apr 14 10:56:55 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 218/644] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:56:55 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:56:55 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:55 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:56:55 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:55 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:56:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:55 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Going to try to terminate instance {{(pid=61840) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:56:55 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871" status: 204 len: 0 microversion: 2.1 time: 0.129317 Apr 14 10:56:55 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 214/645] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:56:55 2023] DELETE /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-88f8532c-2eea-4765-aff6-c1675885d2f2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-88f8532c-2eea-4765-aff6-c1675885d2f2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-88f8532c-2eea-4765-aff6-c1675885d2f2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-88f8532c-2eea-4765-aff6-c1675885d2f2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-88f8532c-2eea-4765-aff6-c1675885d2f2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-88f8532c-2eea-4765-aff6-c1675885d2f2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-88f8532c-2eea-4765-aff6-c1675885d2f2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-88f8532c-2eea-4765-aff6-c1675885d2f2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Getting quotas for project be1c0764b8a843808158644eb90704e6. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Getting quotas for user b3f2157c5d4d441db80ea4a3ca60e4dc and project be1c0764b8a843808158644eb90704e6. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:56:55 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:56:55 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.676060 Apr 14 10:56:55 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 214/646] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:56:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:56:56 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-4c69e8f7-7328-4870-982b-a6bbc44d5da3 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:56 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-4c69e8f7-7328-4870-982b-a6bbc44d5da3 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:56:56 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-4c69e8f7-7328-4870-982b-a6bbc44d5da3 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f2157c5d4d441db80ea4a3ca60e4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1c0764b8a843808158644eb90704e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:56:56 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-4c69e8f7-7328-4870-982b-a6bbc44d5da3 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba" status: 200 len: 1210 microversion: 2.1 time: 0.072882 Apr 14 10:56:56 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 215/647] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:56:56 2023] GET /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba => generated 1210 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:56:56 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-88f8532c-2eea-4765-aff6-c1675885d2f2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:56:56 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-88f8532c-2eea-4765-aff6-c1675885d2f2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871" status: 200 len: 1660 microversion: 2.1 time: 0.199441 Apr 14 10:56:56 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 219/648] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:56:55 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 => generated 1660 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:56:56 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-36787019-6b73-4406-9a7b-52026d578e73 req-d17340e3-881d-40fb-92bb-b6dbb8583724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8586a70e-9855-4177-ac1b-cf707a4df871", "name": "network-vif-unplugged", "status": "completed", "tag": "473d9af8-25a0-4e5a-9afb-7a0c843115cc"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:56:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-36787019-6b73-4406-9a7b-52026d578e73 req-d17340e3-881d-40fb-92bb-b6dbb8583724 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-36787019-6b73-4406-9a7b-52026d578e73 req-d17340e3-881d-40fb-92bb-b6dbb8583724 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-36787019-6b73-4406-9a7b-52026d578e73 req-d17340e3-881d-40fb-92bb-b6dbb8583724 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:56 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-36787019-6b73-4406-9a7b-52026d578e73 req-d17340e3-881d-40fb-92bb-b6dbb8583724 service nova] Creating event network-vif-unplugged:473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance 8586a70e-9855-4177-ac1b-cf707a4df871 on user Apr 14 10:56:56 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-36787019-6b73-4406-9a7b-52026d578e73 req-d17340e3-881d-40fb-92bb-b6dbb8583724 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028837 Apr 14 10:56:56 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 215/649] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:56:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:56:57 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-2a7bfd31-0643-4786-b11f-729a000348e7 req-159edd66-6172-4215-8d72-714d27fe9e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8586a70e-9855-4177-ac1b-cf707a4df871", "name": "network-vif-deleted", "tag": "473d9af8-25a0-4e5a-9afb-7a0c843115cc"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:56:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-2a7bfd31-0643-4786-b11f-729a000348e7 req-159edd66-6172-4215-8d72-714d27fe9e94 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-2a7bfd31-0643-4786-b11f-729a000348e7 req-159edd66-6172-4215-8d72-714d27fe9e94 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-2a7bfd31-0643-4786-b11f-729a000348e7 req-159edd66-6172-4215-8d72-714d27fe9e94 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:57 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-2a7bfd31-0643-4786-b11f-729a000348e7 req-159edd66-6172-4215-8d72-714d27fe9e94 service nova] Creating event network-vif-deleted:473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance 8586a70e-9855-4177-ac1b-cf707a4df871 on user Apr 14 10:56:57 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-2a7bfd31-0643-4786-b11f-729a000348e7 req-159edd66-6172-4215-8d72-714d27fe9e94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036771 Apr 14 10:56:57 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 216/650] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:56:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:56:58 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-d14612b3-f3d5-4ddb-bd22-93b239fb667d req-888d4510-dd24-4d5d-b51b-f65ce1ef11f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8586a70e-9855-4177-ac1b-cf707a4df871", "name": "network-vif-plugged", "status": "completed", "tag": "473d9af8-25a0-4e5a-9afb-7a0c843115cc"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:56:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-d14612b3-f3d5-4ddb-bd22-93b239fb667d req-888d4510-dd24-4d5d-b51b-f65ce1ef11f3 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-d14612b3-f3d5-4ddb-bd22-93b239fb667d req-888d4510-dd24-4d5d-b51b-f65ce1ef11f3 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-d14612b3-f3d5-4ddb-bd22-93b239fb667d req-888d4510-dd24-4d5d-b51b-f65ce1ef11f3 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:58 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-d14612b3-f3d5-4ddb-bd22-93b239fb667d req-888d4510-dd24-4d5d-b51b-f65ce1ef11f3 service nova] Creating event network-vif-plugged:473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance 8586a70e-9855-4177-ac1b-cf707a4df871 on user Apr 14 10:56:58 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-d14612b3-f3d5-4ddb-bd22-93b239fb667d req-888d4510-dd24-4d5d-b51b-f65ce1ef11f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036656 Apr 14 10:56:58 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 220/651] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:56:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:56:58 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-7170cbb4-7b7c-4c08-9ee3-36ac0dc9de94 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:58 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-7170cbb4-7b7c-4c08-9ee3-36ac0dc9de94 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:56:58 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7170cbb4-7b7c-4c08-9ee3-36ac0dc9de94 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:58 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7170cbb4-7b7c-4c08-9ee3-36ac0dc9de94 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:58 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7170cbb4-7b7c-4c08-9ee3-36ac0dc9de94 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:58 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7170cbb4-7b7c-4c08-9ee3-36ac0dc9de94 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:58 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7170cbb4-7b7c-4c08-9ee3-36ac0dc9de94 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:58 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7170cbb4-7b7c-4c08-9ee3-36ac0dc9de94 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:58 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-7170cbb4-7b7c-4c08-9ee3-36ac0dc9de94 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.091509 Apr 14 10:56:58 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 216/652] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 10:56:58 2023] GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/os-interface => generated 282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:56:59 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-e6cfea50-a754-4f74-90a1-a2665fbf9397 req-2eabe6cf-d308-45f1-b682-7b634967c568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade9eacb-d4f9-406d-85c4-043037a4b6ba", "tag": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:56:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-e6cfea50-a754-4f74-90a1-a2665fbf9397 req-2eabe6cf-d308-45f1-b682-7b634967c568 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-e6cfea50-a754-4f74-90a1-a2665fbf9397 req-2eabe6cf-d308-45f1-b682-7b634967c568 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-e6cfea50-a754-4f74-90a1-a2665fbf9397 req-2eabe6cf-d308-45f1-b682-7b634967c568 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:59 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-e6cfea50-a754-4f74-90a1-a2665fbf9397 req-2eabe6cf-d308-45f1-b682-7b634967c568 service nova] Creating event network-changed:2d3b8886-7cd5-44ff-a36d-e576e7b0eabb for instance ade9eacb-d4f9-406d-85c4-043037a4b6ba on user Apr 14 10:56:59 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-e6cfea50-a754-4f74-90a1-a2665fbf9397 req-2eabe6cf-d308-45f1-b682-7b634967c568 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030309 Apr 14 10:56:59 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 217/653] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:56:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:56:59 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:59 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:56:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:59 user devstack@n-api.service[61841]: DEBUG nova.objects.instance [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'services' on Instance uuid d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=61841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:56:59 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/os-volume_attachments/08f71190-2402-402d-af67-edf9226e4fb8" status: 202 len: 0 microversion: 2.1 time: 0.164660 Apr 14 10:56:59 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 221/654] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:56:59 2023] DELETE /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/os-volume_attachments/08f71190-2402-402d-af67-edf9226e4fb8 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:56:59 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-31696dcb-0de3-4bbe-98a6-c73a95bab201 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:56:59 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-31696dcb-0de3-4bbe-98a6-c73a95bab201 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:56:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-31696dcb-0de3-4bbe-98a6-c73a95bab201 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-31696dcb-0de3-4bbe-98a6-c73a95bab201 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-31696dcb-0de3-4bbe-98a6-c73a95bab201 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-31696dcb-0de3-4bbe-98a6-c73a95bab201 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:56:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-31696dcb-0de3-4bbe-98a6-c73a95bab201 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:56:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-31696dcb-0de3-4bbe-98a6-c73a95bab201 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:56:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-31696dcb-0de3-4bbe-98a6-c73a95bab201 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046585 Apr 14 10:56:59 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 217/655] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:56:59 2023] GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-95d18c67-278e-4168-96e4-dfbb272cb755 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-95d18c67-278e-4168-96e4-dfbb272cb755 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-95d18c67-278e-4168-96e4-dfbb272cb755 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-95d18c67-278e-4168-96e4-dfbb272cb755 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-95d18c67-278e-4168-96e4-dfbb272cb755 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-95d18c67-278e-4168-96e4-dfbb272cb755 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-95d18c67-278e-4168-96e4-dfbb272cb755 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-95d18c67-278e-4168-96e4-dfbb272cb755 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:00 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}, {"name": "network-changed", "server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:00 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:00 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:00 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:00 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] Creating event network-changed:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:57:00 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] Creating event network-changed:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:57:00 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-95d18c67-278e-4168-96e4-dfbb272cb755 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.172907 Apr 14 10:57:00 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 218/656] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:57:00 2023] GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb/os-volume_attachments => generated 25 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:57:00 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070842 Apr 14 10:57:00 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 222/657] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:00 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:00 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:00 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:00 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:00 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:00 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:00 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:00 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:00 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:00 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:57:00 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb" status: 204 len: 0 microversion: 2.1 time: 0.125153 Apr 14 10:57:00 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 218/658] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:57:00 2023] DELETE /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-72d89ad6-e5e2-43e5-89c7-a58b821b8e2b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-72d89ad6-e5e2-43e5-89c7-a58b821b8e2b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-72d89ad6-e5e2-43e5-89c7-a58b821b8e2b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-72d89ad6-e5e2-43e5-89c7-a58b821b8e2b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-72d89ad6-e5e2-43e5-89c7-a58b821b8e2b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-72d89ad6-e5e2-43e5-89c7-a58b821b8e2b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-72d89ad6-e5e2-43e5-89c7-a58b821b8e2b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-72d89ad6-e5e2-43e5-89c7-a58b821b8e2b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:00 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-72d89ad6-e5e2-43e5-89c7-a58b821b8e2b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:00 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-72d89ad6-e5e2-43e5-89c7-a58b821b8e2b tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb" status: 200 len: 1668 microversion: 2.1 time: 0.333517 Apr 14 10:57:00 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 219/659] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:57:00 2023] GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb => generated 1668 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:57:01 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd661ae0-c4bb-4117-847d-ef7e85d062fb", "name": "network-vif-unplugged", "status": "completed", "tag": "e2fa8ebc-482c-460c-924a-26111123a1d5"}, {"server_uuid": "cd661ae0-c4bb-4117-847d-ef7e85d062fb", "name": "network-vif-plugged", "status": "completed", "tag": "e2fa8ebc-482c-460c-924a-26111123a1d5"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:01 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] Creating event network-vif-unplugged:e2fa8ebc-482c-460c-924a-26111123a1d5 for instance cd661ae0-c4bb-4117-847d-ef7e85d062fb on user Apr 14 10:57:01 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] Creating event network-vif-plugged:e2fa8ebc-482c-460c-924a-26111123a1d5 for instance cd661ae0-c4bb-4117-847d-ef7e85d062fb on user Apr 14 10:57:01 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.042287 Apr 14 10:57:01 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 223/660] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:01 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:01 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-46b23aa7-7166-4f0c-b986-5287bc8760d6 req-549671b2-e747-4263-86d9-6c94aceaba05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade9eacb-d4f9-406d-85c4-043037a4b6ba", "name": "network-vif-plugged", "status": "completed", "tag": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:01 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-46b23aa7-7166-4f0c-b986-5287bc8760d6 req-549671b2-e747-4263-86d9-6c94aceaba05 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:01 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-46b23aa7-7166-4f0c-b986-5287bc8760d6 req-549671b2-e747-4263-86d9-6c94aceaba05 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:01 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-46b23aa7-7166-4f0c-b986-5287bc8760d6 req-549671b2-e747-4263-86d9-6c94aceaba05 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:01 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-46b23aa7-7166-4f0c-b986-5287bc8760d6 req-549671b2-e747-4263-86d9-6c94aceaba05 service nova] Creating event network-vif-plugged:2d3b8886-7cd5-44ff-a36d-e576e7b0eabb for instance ade9eacb-d4f9-406d-85c4-043037a4b6ba on user Apr 14 10:57:01 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-46b23aa7-7166-4f0c-b986-5287bc8760d6 req-549671b2-e747-4263-86d9-6c94aceaba05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027357 Apr 14 10:57:01 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 219/661] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:03 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-93f9d55d-692f-428a-9c8d-166b80ad304e req-7bc89970-7b7a-4415-aa1f-b3f1ab5067a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade9eacb-d4f9-406d-85c4-043037a4b6ba", "name": "network-vif-plugged", "status": "completed", "tag": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb"}, {"server_uuid": "cd661ae0-c4bb-4117-847d-ef7e85d062fb", "name": "network-vif-deleted", "tag": "e2fa8ebc-482c-460c-924a-26111123a1d5"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-93f9d55d-692f-428a-9c8d-166b80ad304e req-7bc89970-7b7a-4415-aa1f-b3f1ab5067a3 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-93f9d55d-692f-428a-9c8d-166b80ad304e req-7bc89970-7b7a-4415-aa1f-b3f1ab5067a3 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-93f9d55d-692f-428a-9c8d-166b80ad304e req-7bc89970-7b7a-4415-aa1f-b3f1ab5067a3 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:04 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-93f9d55d-692f-428a-9c8d-166b80ad304e req-7bc89970-7b7a-4415-aa1f-b3f1ab5067a3 service nova] Creating event network-vif-plugged:2d3b8886-7cd5-44ff-a36d-e576e7b0eabb for instance ade9eacb-d4f9-406d-85c4-043037a4b6ba on user Apr 14 10:57:04 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-93f9d55d-692f-428a-9c8d-166b80ad304e req-7bc89970-7b7a-4415-aa1f-b3f1ab5067a3 service nova] Creating event network-vif-deleted:e2fa8ebc-482c-460c-924a-26111123a1d5 for instance cd661ae0-c4bb-4117-847d-ef7e85d062fb on user Apr 14 10:57:04 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-93f9d55d-692f-428a-9c8d-166b80ad304e req-7bc89970-7b7a-4415-aa1f-b3f1ab5067a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034743 Apr 14 10:57:04 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 220/662] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:05 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-bba18df2-5f2a-418c-ad9e-e6c237012553 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16be6a85-7b1a-4a9a-bae6-3a6ee7494af8"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:05 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-bba18df2-5f2a-418c-ad9e-e6c237012553 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bba18df2-5f2a-418c-ad9e-e6c237012553 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bba18df2-5f2a-418c-ad9e-e6c237012553 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bba18df2-5f2a-418c-ad9e-e6c237012553 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bba18df2-5f2a-418c-ad9e-e6c237012553 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bba18df2-5f2a-418c-ad9e-e6c237012553 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bba18df2-5f2a-418c-ad9e-e6c237012553 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-bba18df2-5f2a-418c-ad9e-e6c237012553 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.428538 Apr 14 10:57:05 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 224/663] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 10:57:05 2023] POST /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/os-volume_attachments => generated 188 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 10:57:05 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-bb7a1359-4d87-4f1d-af60-8b0d9d43c5b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:05 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-bb7a1359-4d87-4f1d-af60-8b0d9d43c5b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bb7a1359-4d87-4f1d-af60-8b0d9d43c5b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bb7a1359-4d87-4f1d-af60-8b0d9d43c5b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bb7a1359-4d87-4f1d-af60-8b0d9d43c5b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bb7a1359-4d87-4f1d-af60-8b0d9d43c5b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bb7a1359-4d87-4f1d-af60-8b0d9d43c5b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bb7a1359-4d87-4f1d-af60-8b0d9d43c5b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:05 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:57:05 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:57:06 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-bb7a1359-4d87-4f1d-af60-8b0d9d43c5b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/os-volume_attachments/16be6a85-7b1a-4a9a-bae6-3a6ee7494af8" status: 202 len: 0 microversion: 2.20 time: 0.276857 Apr 14 10:57:06 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 220/664] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 10:57:05 2023] DELETE /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/os-volume_attachments/16be6a85-7b1a-4a9a-bae6-3a6ee7494af8 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:57:06 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:57:06 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:06 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:06 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61840) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 10:57:06 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/action" status: 202 len: 0 microversion: 2.20 time: 0.174376 Apr 14 10:57:06 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 221/665] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 10:57:06 2023] POST /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:57:06 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-fcb8ac5c-8423-47de-ba7c-219a636d7ac4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:06 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-fcb8ac5c-8423-47de-ba7c-219a636d7ac4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:06 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fcb8ac5c-8423-47de-ba7c-219a636d7ac4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:06 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fcb8ac5c-8423-47de-ba7c-219a636d7ac4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:06 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fcb8ac5c-8423-47de-ba7c-219a636d7ac4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:06 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fcb8ac5c-8423-47de-ba7c-219a636d7ac4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:06 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fcb8ac5c-8423-47de-ba7c-219a636d7ac4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:06 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fcb8ac5c-8423-47de-ba7c-219a636d7ac4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:06 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-fcb8ac5c-8423-47de-ba7c-219a636d7ac4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:06 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-fcb8ac5c-8423-47de-ba7c-219a636d7ac4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:06 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-fcb8ac5c-8423-47de-ba7c-219a636d7ac4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:06 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-fcb8ac5c-8423-47de-ba7c-219a636d7ac4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" status: 200 len: 1660 microversion: 2.20 time: 0.173546 Apr 14 10:57:06 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 225/666] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:57:06 2023] GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => generated 1660 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:57:08 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-dd2d8995-2ad4-4704-b35f-227eb2498186 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:08 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-dd2d8995-2ad4-4704-b35f-227eb2498186 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dd2d8995-2ad4-4704-b35f-227eb2498186 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dd2d8995-2ad4-4704-b35f-227eb2498186 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dd2d8995-2ad4-4704-b35f-227eb2498186 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dd2d8995-2ad4-4704-b35f-227eb2498186 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dd2d8995-2ad4-4704-b35f-227eb2498186 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dd2d8995-2ad4-4704-b35f-227eb2498186 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:08 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-dd2d8995-2ad4-4704-b35f-227eb2498186 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ad6531a67b4be58a195e1208157b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629ba0ab8074ed8bb4e59d545b74eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:08 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-dd2d8995-2ad4-4704-b35f-227eb2498186 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe" status: 200 len: 1538 microversion: 2.1 time: 0.264882 Apr 14 10:57:08 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 221/667] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:57:08 2023] GET /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe => generated 1538 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:57:08 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-36232f41-ad04-43be-a04d-6d43f8777355 req-cf7ad858-95bc-4445-a3eb-0f546527771f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387", "tag": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-36232f41-ad04-43be-a04d-6d43f8777355 req-cf7ad858-95bc-4445-a3eb-0f546527771f service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-36232f41-ad04-43be-a04d-6d43f8777355 req-cf7ad858-95bc-4445-a3eb-0f546527771f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-36232f41-ad04-43be-a04d-6d43f8777355 req-cf7ad858-95bc-4445-a3eb-0f546527771f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:08 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-36232f41-ad04-43be-a04d-6d43f8777355 req-cf7ad858-95bc-4445-a3eb-0f546527771f service nova] Creating event network-changed:1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 on user Apr 14 10:57:08 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-36232f41-ad04-43be-a04d-6d43f8777355 req-cf7ad858-95bc-4445-a3eb-0f546527771f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039567 Apr 14 10:57:08 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 222/668] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:10 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-f8793eae-b0e4-46de-9c4c-423d41683a56 req-138d76d3-e10d-4405-90ef-7b9f1b7e54d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6580716-8a6a-4dfa-8978-ed54b92af1fe", "tag": "3019f976-f679-4826-8510-3de34b67807c"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:10 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-f8793eae-b0e4-46de-9c4c-423d41683a56 req-138d76d3-e10d-4405-90ef-7b9f1b7e54d6 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:10 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-f8793eae-b0e4-46de-9c4c-423d41683a56 req-138d76d3-e10d-4405-90ef-7b9f1b7e54d6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:10 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-f8793eae-b0e4-46de-9c4c-423d41683a56 req-138d76d3-e10d-4405-90ef-7b9f1b7e54d6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:10 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-f8793eae-b0e4-46de-9c4c-423d41683a56 req-138d76d3-e10d-4405-90ef-7b9f1b7e54d6 service nova] Creating event network-changed:3019f976-f679-4826-8510-3de34b67807c for instance e6580716-8a6a-4dfa-8978-ed54b92af1fe on user Apr 14 10:57:10 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-f8793eae-b0e4-46de-9c4c-423d41683a56 req-138d76d3-e10d-4405-90ef-7b9f1b7e54d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029876 Apr 14 10:57:10 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 226/669] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:10 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f488d00e-998a-40d7-9e77-1bca2436fd95"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:10 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:11 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761586 Apr 14 10:57:11 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 222/670] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:57:10 2023] POST /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:13 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ae7fe3b6-96cc-4d34-bd06-7cc470dfd543 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:13 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-ae7fe3b6-96cc-4d34-bd06-7cc470dfd543 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae7fe3b6-96cc-4d34-bd06-7cc470dfd543 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae7fe3b6-96cc-4d34-bd06-7cc470dfd543 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae7fe3b6-96cc-4d34-bd06-7cc470dfd543 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae7fe3b6-96cc-4d34-bd06-7cc470dfd543 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae7fe3b6-96cc-4d34-bd06-7cc470dfd543 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae7fe3b6-96cc-4d34-bd06-7cc470dfd543 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:13 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-ae7fe3b6-96cc-4d34-bd06-7cc470dfd543 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HTTP exception thrown: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 10:57:13 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ae7fe3b6-96cc-4d34-bd06-7cc470dfd543 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Request method failure captured: Apr 14 10:57:13 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 HTTP/1.1 Apr 14 10:57:13 user devstack@n-api.service[61840]: Accept: application/json Apr 14 10:57:13 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 10:57:13 user devstack@n-api.service[61840]: Connection: close Apr 14 10:57:13 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 10:57:13 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 10:57:13 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 10:57:13 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 10:57:13 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 10:57:13 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS4fQX9Q_RnaEmQ-dAIr-urE_Qf9FeisPSin3UWyuzHmoI_KCuoZr_U9DzdQQueZ8UvQtRxmtFZr_Y67Y5BNWEMQrTX5qpCYKFbqLA-jWMMIHdda2-lQsIJdeeyKqxgQWWAK5mhoWrzOCFu21n0R7jd5he-eoBJ_rPstsQw3ChIPjAc Apr 14 10:57:13 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 10:57:13 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 10:57:13 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 10:57:13 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 10:57:13 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 10:57:13 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 10:57:13 user devstack@n-api.service[61840]: X-Project-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 10:57:13 user devstack@n-api.service[61840]: X-Project-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 10:57:13 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 10:57:13 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 10:57:13 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}] Apr 14 10:57:13 user devstack@n-api.service[61840]: X-Tenant: tempest-ServerActionsTestJSON-1923052090 Apr 14 10:57:13 user devstack@n-api.service[61840]: X-Tenant-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 10:57:13 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 10:57:13 user devstack@n-api.service[61840]: X-User: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 10:57:13 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 10:57:13 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 10:57:13 user devstack@n-api.service[61840]: X-User-Id: 5873a358bf544691b12cd2979f5e36dc Apr 14 10:57:13 user devstack@n-api.service[61840]: X-User-Name: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 10:57:13 user devstack@n-api.service[61840]: method: > Apr 14 10:57:13 user devstack@n-api.service[61840]: exception: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 10:57:13 user devstack@n-api.service[61840]: action_args: {'id': 'b4abb549-8f36-40c5-971f-8accbb14ff86'} Apr 14 10:57:13 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 10:57:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:57:13 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ae7fe3b6-96cc-4d34-bd06-7cc470dfd543 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Returning 404 to user: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:57:13 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-ae7fe3b6-96cc-4d34-bd06-7cc470dfd543 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 404 len: 111 microversion: 2.1 time: 0.040431 Apr 14 10:57:13 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 223/671] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:57:13 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:57:13 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-fdb0e444-2f2c-41ed-b46d-133193c95865 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:13 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-fdb0e444-2f2c-41ed-b46d-133193c95865 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fdb0e444-2f2c-41ed-b46d-133193c95865 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fdb0e444-2f2c-41ed-b46d-133193c95865 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fdb0e444-2f2c-41ed-b46d-133193c95865 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fdb0e444-2f2c-41ed-b46d-133193c95865 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fdb0e444-2f2c-41ed-b46d-133193c95865 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-fdb0e444-2f2c-41ed-b46d-133193c95865 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:13 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-fdb0e444-2f2c-41ed-b46d-133193c95865 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HTTP exception thrown: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 10:57:13 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-fdb0e444-2f2c-41ed-b46d-133193c95865 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Request method failure captured: Apr 14 10:57:13 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/os-volume_attachments HTTP/1.1 Apr 14 10:57:13 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:57:13 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:57:13 user devstack@n-api.service[61841]: Connection: close Apr 14 10:57:13 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 10:57:13 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:57:13 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:57:13 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:57:13 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:57:13 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4fQX9Q_RnaEmQ-dAIr-urE_Qf9FeisPSin3UWyuzHmoI_KCuoZr_U9DzdQQueZ8UvQtRxmtFZr_Y67Y5BNWEMQrTX5qpCYKFbqLA-jWMMIHdda2-lQsIJdeeyKqxgQWWAK5mhoWrzOCFu21n0R7jd5he-eoBJ_rPstsQw3ChIPjAc Apr 14 10:57:13 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:57:13 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:57:13 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:57:13 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:57:13 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:57:13 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:57:13 user devstack@n-api.service[61841]: X-Project-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 10:57:13 user devstack@n-api.service[61841]: X-Project-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 10:57:13 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:57:13 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:57:13 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}] Apr 14 10:57:13 user devstack@n-api.service[61841]: X-Tenant: tempest-ServerActionsTestJSON-1923052090 Apr 14 10:57:13 user devstack@n-api.service[61841]: X-Tenant-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 10:57:13 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 10:57:13 user devstack@n-api.service[61841]: X-User: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 10:57:13 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:57:13 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:57:13 user devstack@n-api.service[61841]: X-User-Id: 5873a358bf544691b12cd2979f5e36dc Apr 14 10:57:13 user devstack@n-api.service[61841]: X-User-Name: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 10:57:13 user devstack@n-api.service[61841]: method: > Apr 14 10:57:13 user devstack@n-api.service[61841]: exception: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 10:57:13 user devstack@n-api.service[61841]: action_args: {'server_id': 'b4abb549-8f36-40c5-971f-8accbb14ff86'} Apr 14 10:57:13 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 10:57:13 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:57:13 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-fdb0e444-2f2c-41ed-b46d-133193c95865 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Returning 404 to user: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:57:13 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-fdb0e444-2f2c-41ed-b46d-133193c95865 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043669 Apr 14 10:57:13 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 227/672] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:57:13 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:57:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-fe68bdde-ef6a-4621-a8ae-9b12161909e6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:14 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-fe68bdde-ef6a-4621-a8ae-9b12161909e6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe68bdde-ef6a-4621-a8ae-9b12161909e6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe68bdde-ef6a-4621-a8ae-9b12161909e6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe68bdde-ef6a-4621-a8ae-9b12161909e6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe68bdde-ef6a-4621-a8ae-9b12161909e6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe68bdde-ef6a-4621-a8ae-9b12161909e6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe68bdde-ef6a-4621-a8ae-9b12161909e6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-fe68bdde-ef6a-4621-a8ae-9b12161909e6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HTTP exception thrown: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 10:57:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-fe68bdde-ef6a-4621-a8ae-9b12161909e6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Request method failure captured: Apr 14 10:57:14 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 HTTP/1.1 Apr 14 10:57:14 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:57:14 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:57:14 user devstack@n-api.service[61839]: Connection: close Apr 14 10:57:14 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:57:14 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:57:14 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:57:14 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:57:14 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:57:14 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS4fQX9Q_RnaEmQ-dAIr-urE_Qf9FeisPSin3UWyuzHmoI_KCuoZr_U9DzdQQueZ8UvQtRxmtFZr_Y67Y5BNWEMQrTX5qpCYKFbqLA-jWMMIHdda2-lQsIJdeeyKqxgQWWAK5mhoWrzOCFu21n0R7jd5he-eoBJ_rPstsQw3ChIPjAc Apr 14 10:57:14 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:57:14 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:57:14 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:57:14 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:57:14 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:57:14 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:57:14 user devstack@n-api.service[61839]: X-Project-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 10:57:14 user devstack@n-api.service[61839]: X-Project-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 10:57:14 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:57:14 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:57:14 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}] Apr 14 10:57:14 user devstack@n-api.service[61839]: X-Tenant: tempest-ServerActionsTestJSON-1923052090 Apr 14 10:57:14 user devstack@n-api.service[61839]: X-Tenant-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 10:57:14 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 10:57:14 user devstack@n-api.service[61839]: X-User: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 10:57:14 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:57:14 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:57:14 user devstack@n-api.service[61839]: X-User-Id: 5873a358bf544691b12cd2979f5e36dc Apr 14 10:57:14 user devstack@n-api.service[61839]: X-User-Name: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 10:57:14 user devstack@n-api.service[61839]: method: > Apr 14 10:57:14 user devstack@n-api.service[61839]: exception: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 10:57:14 user devstack@n-api.service[61839]: action_args: {'id': 'b4abb549-8f36-40c5-971f-8accbb14ff86'} Apr 14 10:57:14 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 10:57:14 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:57:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-fe68bdde-ef6a-4621-a8ae-9b12161909e6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Returning 404 to user: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:57:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-fe68bdde-ef6a-4621-a8ae-9b12161909e6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 404 len: 111 microversion: 2.1 time: 0.028839 Apr 14 10:57:14 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 223/673] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:57:14 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1174054965", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "networks": [{"uuid": "18a91434-637b-4c19-a97b-736b32c1ea5a"}], "security_groups": [{"name": "tempest-securitygroup--494137881"}], "key_name": "tempest-keypair-1544270235", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] validate_networks() for [('18a91434-637b-4c19-a97b-736b32c1ea5a', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting quotas for project 3ea2cb4dfa5b4a52b658efd8f5aefb36. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting quotas for user 5873a358bf544691b12cd2979f5e36dc and project 3ea2cb4dfa5b4a52b658efd8f5aefb36. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:57:14 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:57:14 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.619450 Apr 14 10:57:14 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 224/674] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:57:14 2023] POST /compute/v2.1/servers => generated 403 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:57:14 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-79a0992f-a54e-4f26-94c0-a8a7dc0c089a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:14 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-79a0992f-a54e-4f26-94c0-a8a7dc0c089a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:14 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-79a0992f-a54e-4f26-94c0-a8a7dc0c089a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:14 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-79a0992f-a54e-4f26-94c0-a8a7dc0c089a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" status: 200 len: 1233 microversion: 2.1 time: 0.101484 Apr 14 10:57:14 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 228/675] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:57:14 2023] GET /compute/v2.1/servers/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 => generated 1233 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:57:16 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-cab6c7b3-8c18-40d9-831e-2072c9ef78c3 req-ff3c9fd6-c178-4b62-a268-ec3d8832bedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387", "name": "network-vif-plugged", "status": "completed", "tag": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cab6c7b3-8c18-40d9-831e-2072c9ef78c3 req-ff3c9fd6-c178-4b62-a268-ec3d8832bedb service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cab6c7b3-8c18-40d9-831e-2072c9ef78c3 req-ff3c9fd6-c178-4b62-a268-ec3d8832bedb service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cab6c7b3-8c18-40d9-831e-2072c9ef78c3 req-ff3c9fd6-c178-4b62-a268-ec3d8832bedb service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:16 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-cab6c7b3-8c18-40d9-831e-2072c9ef78c3 req-ff3c9fd6-c178-4b62-a268-ec3d8832bedb service nova] Creating event network-vif-plugged:1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 on user Apr 14 10:57:16 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-cab6c7b3-8c18-40d9-831e-2072c9ef78c3 req-ff3c9fd6-c178-4b62-a268-ec3d8832bedb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042585 Apr 14 10:57:16 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 224/676] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:18 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387", "name": "network-vif-plugged", "status": "completed", "tag": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff"}, {"name": "network-changed", "server_uuid": "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7", "tag": "ec941aab-7c95-415b-96bc-e74ebaeb9385"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] Creating event network-vif-plugged:1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 on user Apr 14 10:57:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] Creating event network-changed:ec941aab-7c95-415b-96bc-e74ebaeb9385 for instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 on user Apr 14 10:57:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.041654 Apr 14 10:57:18 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 225/677] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:18 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:20 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:20 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:20 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-4b02bb2c-94ac-4148-b372-acbf76e0bdef req-40bfde2b-c490-4705-b31c-39dad5c634a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7", "name": "network-vif-plugged", "status": "completed", "tag": "ec941aab-7c95-415b-96bc-e74ebaeb9385"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4b02bb2c-94ac-4148-b372-acbf76e0bdef req-40bfde2b-c490-4705-b31c-39dad5c634a3 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4b02bb2c-94ac-4148-b372-acbf76e0bdef req-40bfde2b-c490-4705-b31c-39dad5c634a3 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4b02bb2c-94ac-4148-b372-acbf76e0bdef req-40bfde2b-c490-4705-b31c-39dad5c634a3 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:20 user devstack@n-api.service[61841]: DEBUG nova.objects.instance [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lazy-loading 'services' on Instance uuid e6580716-8a6a-4dfa-8978-ed54b92af1fe {{(pid=61841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:57:20 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-4b02bb2c-94ac-4148-b372-acbf76e0bdef req-40bfde2b-c490-4705-b31c-39dad5c634a3 service nova] Creating event network-vif-plugged:ec941aab-7c95-415b-96bc-e74ebaeb9385 for instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 on user Apr 14 10:57:20 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-4b02bb2c-94ac-4148-b372-acbf76e0bdef req-40bfde2b-c490-4705-b31c-39dad5c634a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045970 Apr 14 10:57:20 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 225/678] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:20 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe/os-volume_attachments/f488d00e-998a-40d7-9e77-1bca2436fd95" status: 202 len: 0 microversion: 2.1 time: 0.203081 Apr 14 10:57:20 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 229/679] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:57:20 2023] DELETE /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe/os-volume_attachments/f488d00e-998a-40d7-9e77-1bca2436fd95 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 10:57:20 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-5b2ddd06-cccf-4ea4-84d6-a96f9d19f7d8 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:20 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-5b2ddd06-cccf-4ea4-84d6-a96f9d19f7d8 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5b2ddd06-cccf-4ea4-84d6-a96f9d19f7d8 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5b2ddd06-cccf-4ea4-84d6-a96f9d19f7d8 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5b2ddd06-cccf-4ea4-84d6-a96f9d19f7d8 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5b2ddd06-cccf-4ea4-84d6-a96f9d19f7d8 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5b2ddd06-cccf-4ea4-84d6-a96f9d19f7d8 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5b2ddd06-cccf-4ea4-84d6-a96f9d19f7d8 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:20 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-5b2ddd06-cccf-4ea4-84d6-a96f9d19f7d8 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057824 Apr 14 10:57:20 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 226/680] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:57:20 2023] GET /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:22 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-4468a6db-97ae-4c51-8172-b90c139ae34f req-c6129df8-59d3-4b12-bd84-4dee1a3659da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7", "name": "network-vif-plugged", "status": "completed", "tag": "ec941aab-7c95-415b-96bc-e74ebaeb9385"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4468a6db-97ae-4c51-8172-b90c139ae34f req-c6129df8-59d3-4b12-bd84-4dee1a3659da service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4468a6db-97ae-4c51-8172-b90c139ae34f req-c6129df8-59d3-4b12-bd84-4dee1a3659da service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:22 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4468a6db-97ae-4c51-8172-b90c139ae34f req-c6129df8-59d3-4b12-bd84-4dee1a3659da service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:22 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-4468a6db-97ae-4c51-8172-b90c139ae34f req-c6129df8-59d3-4b12-bd84-4dee1a3659da service nova] Creating event network-vif-plugged:ec941aab-7c95-415b-96bc-e74ebaeb9385 for instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 on user Apr 14 10:57:22 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-4468a6db-97ae-4c51-8172-b90c139ae34f req-c6129df8-59d3-4b12-bd84-4dee1a3659da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032318 Apr 14 10:57:22 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 226/681] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:42 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:57:42 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=26 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:57:42 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=5,nova_cell1:UPDATE=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:57:42 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-480651215"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:42 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:43 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a936fb20-3f17-4114-829a-8659da6bc5f3/action" status: 202 len: 52 microversion: 2.87 time: 1.234710 Apr 14 10:57:43 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 230/682] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 10:57:41 2023] POST /compute/v2.1/servers/a936fb20-3f17-4114-829a-8659da6bc5f3/action => generated 52 bytes in 1236 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 10:57:46 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-eff25161-1c3d-4eaa-968f-2065d50779fa tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:46 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-eff25161-1c3d-4eaa-968f-2065d50779fa tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:46 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:57:46 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:57:46 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:57:46 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:57:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-eff25161-1c3d-4eaa-968f-2065d50779fa tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-eff25161-1c3d-4eaa-968f-2065d50779fa tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-eff25161-1c3d-4eaa-968f-2065d50779fa tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-eff25161-1c3d-4eaa-968f-2065d50779fa tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-eff25161-1c3d-4eaa-968f-2065d50779fa tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-eff25161-1c3d-4eaa-968f-2065d50779fa tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:46 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:57:46 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:57:46 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-38293d7c-2a72-455c-91f7-53bddb9e76df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:46 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-38293d7c-2a72-455c-91f7-53bddb9e76df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-38293d7c-2a72-455c-91f7-53bddb9e76df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-38293d7c-2a72-455c-91f7-53bddb9e76df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-38293d7c-2a72-455c-91f7-53bddb9e76df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-38293d7c-2a72-455c-91f7-53bddb9e76df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-38293d7c-2a72-455c-91f7-53bddb9e76df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-38293d7c-2a72-455c-91f7-53bddb9e76df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-38293d7c-2a72-455c-91f7-53bddb9e76df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] HTTP exception thrown: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. Apr 14 10:57:46 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-38293d7c-2a72-455c-91f7-53bddb9e76df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Request method failure captured: Apr 14 10:57:46 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 HTTP/1.1 Apr 14 10:57:46 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:57:46 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:57:46 user devstack@n-api.service[61839]: Connection: close Apr 14 10:57:46 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:57:46 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:57:46 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:57:46 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:57:46 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:57:46 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS84vM36G7Nioj-ToQvoMdFXKF2xLhh7C9a3nbB4y18IkUJEogQn474a0MLG191bnwycwvsi0zS8LTGssOiGIEYNvHQjgijI-jHv2hvRRh1UXWy8xpVhO7o4yY1wPKzSfRxurp_fOMRnE8XRArHY8IVEqoNbCj4XRAQxEHh0XdXxD38 Apr 14 10:57:46 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:57:46 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:57:46 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:57:46 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:57:46 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:57:46 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:57:46 user devstack@n-api.service[61839]: X-Project-Id: eb9b9fc4f2e244879502006bb844761c Apr 14 10:57:46 user devstack@n-api.service[61839]: X-Project-Name: tempest-AttachVolumeTestJSON-821788322 Apr 14 10:57:46 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:57:46 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:57:46 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb9b9fc4f2e244879502006bb844761c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb9b9fc4f2e244879502006bb844761c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb9b9fc4f2e244879502006bb844761c"}]}] Apr 14 10:57:46 user devstack@n-api.service[61839]: X-Tenant: tempest-AttachVolumeTestJSON-821788322 Apr 14 10:57:46 user devstack@n-api.service[61839]: X-Tenant-Id: eb9b9fc4f2e244879502006bb844761c Apr 14 10:57:46 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821788322 Apr 14 10:57:46 user devstack@n-api.service[61839]: X-User: tempest-AttachVolumeTestJSON-821788322-project-member Apr 14 10:57:46 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:57:46 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:57:46 user devstack@n-api.service[61839]: X-User-Id: 11cb4a1e78d447dbb18cde5453fe499c Apr 14 10:57:46 user devstack@n-api.service[61839]: X-User-Name: tempest-AttachVolumeTestJSON-821788322-project-member Apr 14 10:57:46 user devstack@n-api.service[61839]: method: > Apr 14 10:57:46 user devstack@n-api.service[61839]: exception: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. Apr 14 10:57:46 user devstack@n-api.service[61839]: action_args: {'id': '8586a70e-9855-4177-ac1b-cf707a4df871'} Apr 14 10:57:46 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. Apr 14 10:57:46 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:57:46 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-38293d7c-2a72-455c-91f7-53bddb9e76df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Returning 404 to user: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:57:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-38293d7c-2a72-455c-91f7-53bddb9e76df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871" status: 404 len: 111 microversion: 2.1 time: 0.034384 Apr 14 10:57:46 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 227/683] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:57:46 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:57:46 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-78b2c830-6bcf-438f-b8cb-977c5b96833f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '.version_select at 0x7fcd1cfb8940>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:46 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-78b2c830-6bcf-438f-b8cb-977c5b96833f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352311307" status: 202 len: 0 microversion: 2.1 time: 0.021119 Apr 14 10:57:46 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 231/684] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 10:57:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352311307 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:57:46 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-eff25161-1c3d-4eaa-968f-2065d50779fa tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f2157c5d4d441db80ea4a3ca60e4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1c0764b8a843808158644eb90704e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:46 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-eff25161-1c3d-4eaa-968f-2065d50779fa tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba" status: 200 len: 1493 microversion: 2.1 time: 0.197024 Apr 14 10:57:46 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 227/685] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:57:46 2023] GET /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba => generated 1493 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:57:46 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-0080f1f7-c58a-458b-a78f-625cbdea4573 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Action: 'create', calling method: .version_select at 0x7fcd1ceeb760>, body: {"keypair": {"name": "tempest-keypair-1954654699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFX4psVsnJ7YiVMlmDva54tVnsB3EA7ThlyG0DNat7parQ+EKTGjR4spXyHIu1F0sE5iuPdm8WruPRGM1gtmd8ovAAupZwja/Lb7SJjV4yMTxDx05zIxkiT3ZZ1VUWZmA=="}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:46 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-0080f1f7-c58a-458b-a78f-625cbdea4573 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting quotas for project eb9b9fc4f2e244879502006bb844761c. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:57:46 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-0080f1f7-c58a-458b-a78f-625cbdea4573 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting quotas for user 11cb4a1e78d447dbb18cde5453fe499c and project eb9b9fc4f2e244879502006bb844761c. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:57:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-0080f1f7-c58a-458b-a78f-625cbdea4573 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048250 Apr 14 10:57:46 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 228/686] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 10:57:46 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:48 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-7bd4ef94-6488-41c5-b747-2f93b8eefc5e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:48 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-7bd4ef94-6488-41c5-b747-2f93b8eefc5e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7bd4ef94-6488-41c5-b747-2f93b8eefc5e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7bd4ef94-6488-41c5-b747-2f93b8eefc5e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7bd4ef94-6488-41c5-b747-2f93b8eefc5e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7bd4ef94-6488-41c5-b747-2f93b8eefc5e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7bd4ef94-6488-41c5-b747-2f93b8eefc5e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:48 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7bd4ef94-6488-41c5-b747-2f93b8eefc5e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:48 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-7bd4ef94-6488-41c5-b747-2f93b8eefc5e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:48 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-7bd4ef94-6488-41c5-b747-2f93b8eefc5e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:48 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-7bd4ef94-6488-41c5-b747-2f93b8eefc5e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:48 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-7bd4ef94-6488-41c5-b747-2f93b8eefc5e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a936fb20-3f17-4114-829a-8659da6bc5f3" status: 200 len: 1690 microversion: 2.87 time: 0.174143 Apr 14 10:57:48 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 232/687] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:57:48 2023] GET /compute/v2.1/servers/a936fb20-3f17-4114-829a-8659da6bc5f3 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:57:48 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1620846551", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "653f0c81-1afd-4ca6-9639-675ead1a6127"}], "security_groups": [{"name": "tempest-securitygroup--1055474055"}], "key_name": "tempest-keypair-1954654699", "user_data": "}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:48 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] validate_networks() for [('653f0c81-1afd-4ca6-9639-675ead1a6127', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting quotas for project eb9b9fc4f2e244879502006bb844761c. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting quotas for user 11cb4a1e78d447dbb18cde5453fe499c and project eb9b9fc4f2e244879502006bb844761c. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:57:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.672507 Apr 14 10:57:49 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 228/688] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:57:48 2023] POST /compute/v2.1/servers => generated 400 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:57:49 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-9b43852f-1afa-46ea-abea-0e130992ed55 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:49 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-9b43852f-1afa-46ea-abea-0e130992ed55 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:49 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-9b43852f-1afa-46ea-abea-0e130992ed55 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:49 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-9b43852f-1afa-46ea-abea-0e130992ed55 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e" status: 200 len: 1232 microversion: 2.1 time: 0.074404 Apr 14 10:57:49 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 229/689] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:57:49 2023] GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e => generated 1232 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:57:49 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-3562f481-c392-444f-848e-417859e1f9ee tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:49 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-3562f481-c392-444f-848e-417859e1f9ee tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3562f481-c392-444f-848e-417859e1f9ee tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3562f481-c392-444f-848e-417859e1f9ee tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3562f481-c392-444f-848e-417859e1f9ee tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3562f481-c392-444f-848e-417859e1f9ee tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3562f481-c392-444f-848e-417859e1f9ee tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3562f481-c392-444f-848e-417859e1f9ee tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:49 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-3562f481-c392-444f-848e-417859e1f9ee tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044818 Apr 14 10:57:49 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 233/690] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:57:49 2023] GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:49 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Going to try to terminate instance {{(pid=61840) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:57:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" status: 204 len: 0 microversion: 2.1 time: 0.119221 Apr 14 10:57:50 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 229/691] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:57:49 2023] DELETE /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:57:50 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-375e0437-588f-4d0e-bd48-4cc45a2e7392 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:50 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-375e0437-588f-4d0e-bd48-4cc45a2e7392 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:50 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-375e0437-588f-4d0e-bd48-4cc45a2e7392 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:50 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-375e0437-588f-4d0e-bd48-4cc45a2e7392 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:50 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-375e0437-588f-4d0e-bd48-4cc45a2e7392 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:50 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-375e0437-588f-4d0e-bd48-4cc45a2e7392 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:50 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-375e0437-588f-4d0e-bd48-4cc45a2e7392 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:50 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-375e0437-588f-4d0e-bd48-4cc45a2e7392 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:50 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-375e0437-588f-4d0e-bd48-4cc45a2e7392 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:50 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-375e0437-588f-4d0e-bd48-4cc45a2e7392 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" status: 200 len: 1677 microversion: 2.1 time: 0.208824 Apr 14 10:57:50 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 230/692] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:57:50 2023] GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:57:50 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-570e8bf1-f409-4653-80dd-4dc8058decc1 req-ef0b8780-66d4-45b5-b57b-6f4b355ba3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "name": "network-vif-unplugged", "status": "completed", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-570e8bf1-f409-4653-80dd-4dc8058decc1 req-ef0b8780-66d4-45b5-b57b-6f4b355ba3c8 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-570e8bf1-f409-4653-80dd-4dc8058decc1 req-ef0b8780-66d4-45b5-b57b-6f4b355ba3c8 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-570e8bf1-f409-4653-80dd-4dc8058decc1 req-ef0b8780-66d4-45b5-b57b-6f4b355ba3c8 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-570e8bf1-f409-4653-80dd-4dc8058decc1 req-ef0b8780-66d4-45b5-b57b-6f4b355ba3c8 service nova] Creating event network-vif-unplugged:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:57:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-570e8bf1-f409-4653-80dd-4dc8058decc1 req-ef0b8780-66d4-45b5-b57b-6f4b355ba3c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031028 Apr 14 10:57:50 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 234/693] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:50 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-8bb7e0a8-6d88-48bc-b735-acecc820e168 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:50 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-8bb7e0a8-6d88-48bc-b735-acecc820e168 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8bb7e0a8-6d88-48bc-b735-acecc820e168 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8bb7e0a8-6d88-48bc-b735-acecc820e168 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8bb7e0a8-6d88-48bc-b735-acecc820e168 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8bb7e0a8-6d88-48bc-b735-acecc820e168 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8bb7e0a8-6d88-48bc-b735-acecc820e168 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8bb7e0a8-6d88-48bc-b735-acecc820e168 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:51 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-8bb7e0a8-6d88-48bc-b735-acecc820e168 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HTTP exception thrown: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. Apr 14 10:57:51 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-8bb7e0a8-6d88-48bc-b735-acecc820e168 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Request method failure captured: Apr 14 10:57:51 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb HTTP/1.1 Apr 14 10:57:51 user devstack@n-api.service[61840]: Accept: application/json Apr 14 10:57:51 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 10:57:51 user devstack@n-api.service[61840]: Connection: close Apr 14 10:57:51 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 10:57:51 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 10:57:51 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 10:57:51 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 10:57:51 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 10:57:51 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTAm6v8qUESI0IjizmIjmsJWXGLOjjeSrv09ri2T6RAbvAYajYyIrxw22PgYPfP-sFhLjBYVsJQMKmp7KoYSOSHZjTqklYHtEK1WW90dx3jL-AC6Ab0TV_VkQ0gzFfhCxphVnwf0RVdI8bvNKr-C_80J359JrotPIMB_M0XXXvYIzcQ Apr 14 10:57:51 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 10:57:51 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 10:57:51 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 10:57:51 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 10:57:51 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 10:57:51 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 10:57:51 user devstack@n-api.service[61840]: X-Project-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 10:57:51 user devstack@n-api.service[61840]: X-Project-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 10:57:51 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 10:57:51 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 10:57:51 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}] Apr 14 10:57:51 user devstack@n-api.service[61840]: X-Tenant: tempest-AttachVolumeNegativeTest-531644967 Apr 14 10:57:51 user devstack@n-api.service[61840]: X-Tenant-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 10:57:51 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 10:57:51 user devstack@n-api.service[61840]: X-User: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 10:57:51 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 10:57:51 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 10:57:51 user devstack@n-api.service[61840]: X-User-Id: 78adbbdcd10e446daddde754e46309b2 Apr 14 10:57:51 user devstack@n-api.service[61840]: X-User-Name: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 10:57:51 user devstack@n-api.service[61840]: method: > Apr 14 10:57:51 user devstack@n-api.service[61840]: exception: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. Apr 14 10:57:51 user devstack@n-api.service[61840]: action_args: {'id': 'cd661ae0-c4bb-4117-847d-ef7e85d062fb'} Apr 14 10:57:51 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. Apr 14 10:57:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:57:51 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-8bb7e0a8-6d88-48bc-b735-acecc820e168 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Returning 404 to user: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:57:51 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-8bb7e0a8-6d88-48bc-b735-acecc820e168 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb" status: 404 len: 111 microversion: 2.1 time: 0.033344 Apr 14 10:57:51 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 230/694] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:57:50 2023] GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:57:51 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-41c6ceed-ef1b-4b79-8303-7e40d3fbc7e2 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '.version_select at 0x7fcd1cee8550>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:51 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-41c6ceed-ef1b-4b79-8303-7e40d3fbc7e2 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-388083155" status: 202 len: 0 microversion: 2.1 time: 0.025563 Apr 14 10:57:51 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 231/695] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 10:57:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-388083155 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 10:57:51 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-4338036c-0742-4bc0-9a04-03f7423f1aab tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d36d900>, body: {"keypair": {"name": "tempest-keypair-880478313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw2SbFQpaxlXMigCU4SqREng1yFr8b6iVL8PJBLSwkK3b0e1hzyI9V2EhI2s6XMdqIXAYQuGjq1aeQdXx9cKlSvkg7nGGryoncSoq6eFhl2+423Xeuz3aQWMczJJSdSEQ=="}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:51 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-4338036c-0742-4bc0-9a04-03f7423f1aab tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for project cb8f294f957f4c74ae959c1e9f238427. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:57:51 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-4338036c-0742-4bc0-9a04-03f7423f1aab tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for user 78adbbdcd10e446daddde754e46309b2 and project cb8f294f957f4c74ae959c1e9f238427. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:57:51 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-8bdf08c4-5720-4a61-89ca-ea9aeebc8fd1 req-40cfa371-138c-4a85-8d1a-fc73270d6a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "name": "network-vif-deleted", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:51 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-4338036c-0742-4bc0-9a04-03f7423f1aab tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050717 Apr 14 10:57:51 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 235/696] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 10:57:51 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8bdf08c4-5720-4a61-89ca-ea9aeebc8fd1 req-40cfa371-138c-4a85-8d1a-fc73270d6a0b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8bdf08c4-5720-4a61-89ca-ea9aeebc8fd1 req-40cfa371-138c-4a85-8d1a-fc73270d6a0b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8bdf08c4-5720-4a61-89ca-ea9aeebc8fd1 req-40cfa371-138c-4a85-8d1a-fc73270d6a0b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:51 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-8bdf08c4-5720-4a61-89ca-ea9aeebc8fd1 req-40cfa371-138c-4a85-8d1a-fc73270d6a0b service nova] Creating event network-vif-deleted:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:57:51 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-8bdf08c4-5720-4a61-89ca-ea9aeebc8fd1 req-40cfa371-138c-4a85-8d1a-fc73270d6a0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030661 Apr 14 10:57:51 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 231/697] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:52 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-a9f46065-9d32-44d3-b7f0-260536ce1c81 req-e2789677-d409-451b-8365-28d8522b9807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5", "name": "network-vif-plugged", "status": "completed", "tag": "f2196ef3-aada-48d6-b524-5e9cef6a9eda"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-a9f46065-9d32-44d3-b7f0-260536ce1c81 req-e2789677-d409-451b-8365-28d8522b9807 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-a9f46065-9d32-44d3-b7f0-260536ce1c81 req-e2789677-d409-451b-8365-28d8522b9807 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-a9f46065-9d32-44d3-b7f0-260536ce1c81 req-e2789677-d409-451b-8365-28d8522b9807 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:52 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-a9f46065-9d32-44d3-b7f0-260536ce1c81 req-e2789677-d409-451b-8365-28d8522b9807 service nova] Creating event network-vif-plugged:f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 on user Apr 14 10:57:52 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-a9f46065-9d32-44d3-b7f0-260536ce1c81 req-e2789677-d409-451b-8365-28d8522b9807 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056500 Apr 14 10:57:52 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 232/698] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:52 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-a7a9097e-34f9-4d39-89b8-352f311bd3a5 req-66dd9cd1-ac70-45fa-8116-d92997eac405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb99276-64ba-4641-8869-3f35eea2f76e", "tag": "7e4a1964-f2d0-4a4f-81fc-adf97c621209"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-a7a9097e-34f9-4d39-89b8-352f311bd3a5 req-66dd9cd1-ac70-45fa-8116-d92997eac405 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-a7a9097e-34f9-4d39-89b8-352f311bd3a5 req-66dd9cd1-ac70-45fa-8116-d92997eac405 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-a7a9097e-34f9-4d39-89b8-352f311bd3a5 req-66dd9cd1-ac70-45fa-8116-d92997eac405 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:52 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-a7a9097e-34f9-4d39-89b8-352f311bd3a5 req-66dd9cd1-ac70-45fa-8116-d92997eac405 service nova] Creating event network-changed:7e4a1964-f2d0-4a4f-81fc-adf97c621209 for instance 0bb99276-64ba-4641-8869-3f35eea2f76e on user Apr 14 10:57:52 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-a7a9097e-34f9-4d39-89b8-352f311bd3a5 req-66dd9cd1-ac70-45fa-8116-d92997eac405 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041014 Apr 14 10:57:52 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 236/699] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:53 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2120803394", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b639a68a-2b4e-435c-b98b-65b5b4981c73"}], "security_groups": [{"name": "tempest-securitygroup--918837403"}], "key_name": "tempest-keypair-880478313", "user_data": "}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:53 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] validate_networks() for [('b639a68a-2b4e-435c-b98b-65b5b4981c73', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:57:54 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:57:54 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:57:54 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:57:54 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:57:54 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:57:54 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:54 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:54 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:54 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:54 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:54 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:54 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for project cb8f294f957f4c74ae959c1e9f238427. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:57:54 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for user 78adbbdcd10e446daddde754e46309b2 and project cb8f294f957f4c74ae959c1e9f238427. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:57:54 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:57:54 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:57:54 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.588826 Apr 14 10:57:54 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 232/700] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:57:53 2023] POST /compute/v2.1/servers => generated 399 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:57:54 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-e6e01f3e-65e4-45a8-94e8-7581d56f1691 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:54 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-e6e01f3e-65e4-45a8-94e8-7581d56f1691 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:54 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-e6e01f3e-65e4-45a8-94e8-7581d56f1691 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:54 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-e6e01f3e-65e4-45a8-94e8-7581d56f1691 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94" status: 200 len: 1235 microversion: 2.1 time: 0.116414 Apr 14 10:57:54 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 233/701] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:57:54 2023] GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94 => generated 1235 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:57:55 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-87992b7c-d172-4227-8dd1-4d7255e09091 req-b9636479-0b91-4578-b196-52a9c2275133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb99276-64ba-4641-8869-3f35eea2f76e", "name": "network-vif-plugged", "status": "completed", "tag": "7e4a1964-f2d0-4a4f-81fc-adf97c621209"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-87992b7c-d172-4227-8dd1-4d7255e09091 req-b9636479-0b91-4578-b196-52a9c2275133 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-87992b7c-d172-4227-8dd1-4d7255e09091 req-b9636479-0b91-4578-b196-52a9c2275133 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-87992b7c-d172-4227-8dd1-4d7255e09091 req-b9636479-0b91-4578-b196-52a9c2275133 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:55 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-87992b7c-d172-4227-8dd1-4d7255e09091 req-b9636479-0b91-4578-b196-52a9c2275133 service nova] Creating event network-vif-plugged:7e4a1964-f2d0-4a4f-81fc-adf97c621209 for instance 0bb99276-64ba-4641-8869-3f35eea2f76e on user Apr 14 10:57:55 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-87992b7c-d172-4227-8dd1-4d7255e09091 req-b9636479-0b91-4578-b196-52a9c2275133 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046259 Apr 14 10:57:55 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 237/702] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:57:56 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-f5e7a562-1d38-4cb5-ae75-e9c10803d5ff tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:57:56 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-f5e7a562-1d38-4cb5-ae75-e9c10803d5ff tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:57:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f5e7a562-1d38-4cb5-ae75-e9c10803d5ff tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f5e7a562-1d38-4cb5-ae75-e9c10803d5ff tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f5e7a562-1d38-4cb5-ae75-e9c10803d5ff tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f5e7a562-1d38-4cb5-ae75-e9c10803d5ff tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f5e7a562-1d38-4cb5-ae75-e9c10803d5ff tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f5e7a562-1d38-4cb5-ae75-e9c10803d5ff tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:56 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-f5e7a562-1d38-4cb5-ae75-e9c10803d5ff tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:56 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-f5e7a562-1d38-4cb5-ae75-e9c10803d5ff tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:56 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-f5e7a562-1d38-4cb5-ae75-e9c10803d5ff tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:57:56 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-f5e7a562-1d38-4cb5-ae75-e9c10803d5ff tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" status: 200 len: 1705 microversion: 2.20 time: 0.158231 Apr 14 10:57:56 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 233/703] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:57:56 2023] GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => generated 1705 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:57:57 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-1d68c8bb-b19a-4f4f-9a97-c74440a02d77 req-71ad06ea-7357-4f51-ad88-68028f2e3c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb99276-64ba-4641-8869-3f35eea2f76e", "name": "network-vif-plugged", "status": "completed", "tag": "7e4a1964-f2d0-4a4f-81fc-adf97c621209"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:57:57 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1d68c8bb-b19a-4f4f-9a97-c74440a02d77 req-71ad06ea-7357-4f51-ad88-68028f2e3c61 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:57:57 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1d68c8bb-b19a-4f4f-9a97-c74440a02d77 req-71ad06ea-7357-4f51-ad88-68028f2e3c61 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:57:57 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1d68c8bb-b19a-4f4f-9a97-c74440a02d77 req-71ad06ea-7357-4f51-ad88-68028f2e3c61 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:57:57 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-1d68c8bb-b19a-4f4f-9a97-c74440a02d77 req-71ad06ea-7357-4f51-ad88-68028f2e3c61 service nova] Creating event network-vif-plugged:7e4a1964-f2d0-4a4f-81fc-adf97c621209 for instance 0bb99276-64ba-4641-8869-3f35eea2f76e on user Apr 14 10:57:57 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-1d68c8bb-b19a-4f4f-9a97-c74440a02d77 req-71ad06ea-7357-4f51-ad88-68028f2e3c61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028041 Apr 14 10:57:57 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 234/704] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:57:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:58:00 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-bef7a554-0e28-4de1-901e-c940379f2ba7 req-19ed5ddf-8b58-411b-9619-e4944c86c6af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef413492-c781-459e-b99c-46a530034c94", "tag": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:00 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-bef7a554-0e28-4de1-901e-c940379f2ba7 req-19ed5ddf-8b58-411b-9619-e4944c86c6af service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:00 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-bef7a554-0e28-4de1-901e-c940379f2ba7 req-19ed5ddf-8b58-411b-9619-e4944c86c6af service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:00 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-bef7a554-0e28-4de1-901e-c940379f2ba7 req-19ed5ddf-8b58-411b-9619-e4944c86c6af service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:00 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-bef7a554-0e28-4de1-901e-c940379f2ba7 req-19ed5ddf-8b58-411b-9619-e4944c86c6af service nova] Creating event network-changed:9e57c0d8-8572-4355-b3c0-d2b74196fc0d for instance ef413492-c781-459e-b99c-46a530034c94 on user Apr 14 10:58:00 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-bef7a554-0e28-4de1-901e-c940379f2ba7 req-19ed5ddf-8b58-411b-9619-e4944c86c6af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030630 Apr 14 10:58:00 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 238/705] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:58:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:58:02 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-68356f2a-2276-43fb-8619-2f72e9dba214 req-4d2a8470-1363-43f5-af11-eba557a1877d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef413492-c781-459e-b99c-46a530034c94", "name": "network-vif-plugged", "status": "completed", "tag": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-68356f2a-2276-43fb-8619-2f72e9dba214 req-4d2a8470-1363-43f5-af11-eba557a1877d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-68356f2a-2276-43fb-8619-2f72e9dba214 req-4d2a8470-1363-43f5-af11-eba557a1877d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-68356f2a-2276-43fb-8619-2f72e9dba214 req-4d2a8470-1363-43f5-af11-eba557a1877d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:02 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-68356f2a-2276-43fb-8619-2f72e9dba214 req-4d2a8470-1363-43f5-af11-eba557a1877d service nova] Creating event network-vif-plugged:9e57c0d8-8572-4355-b3c0-d2b74196fc0d for instance ef413492-c781-459e-b99c-46a530034c94 on user Apr 14 10:58:02 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-68356f2a-2276-43fb-8619-2f72e9dba214 req-4d2a8470-1363-43f5-af11-eba557a1877d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095929 Apr 14 10:58:02 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 234/706] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:58:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:58:04 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=8 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:04 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-631f7ceb-754c-4728-9a8e-c03cf9c7ae57 req-7f372671-1972-41a2-8eb3-646e97d51993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef413492-c781-459e-b99c-46a530034c94", "name": "network-vif-plugged", "status": "completed", "tag": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-631f7ceb-754c-4728-9a8e-c03cf9c7ae57 req-7f372671-1972-41a2-8eb3-646e97d51993 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-631f7ceb-754c-4728-9a8e-c03cf9c7ae57 req-7f372671-1972-41a2-8eb3-646e97d51993 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-631f7ceb-754c-4728-9a8e-c03cf9c7ae57 req-7f372671-1972-41a2-8eb3-646e97d51993 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:04 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-631f7ceb-754c-4728-9a8e-c03cf9c7ae57 req-7f372671-1972-41a2-8eb3-646e97d51993 service nova] Creating event network-vif-plugged:9e57c0d8-8572-4355-b3c0-d2b74196fc0d for instance ef413492-c781-459e-b99c-46a530034c94 on user Apr 14 10:58:04 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-631f7ceb-754c-4728-9a8e-c03cf9c7ae57 req-7f372671-1972-41a2-8eb3-646e97d51993 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036939 Apr 14 10:58:04 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 235/707] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:58:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:58:04 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:04 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-bd01f3fb-444b-47f1-bba5-c873076f46b8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:58:04 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-bd01f3fb-444b-47f1-bba5-c873076f46b8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:58:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bd01f3fb-444b-47f1-bba5-c873076f46b8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bd01f3fb-444b-47f1-bba5-c873076f46b8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bd01f3fb-444b-47f1-bba5-c873076f46b8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bd01f3fb-444b-47f1-bba5-c873076f46b8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bd01f3fb-444b-47f1-bba5-c873076f46b8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bd01f3fb-444b-47f1-bba5-c873076f46b8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:05 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-bd01f3fb-444b-47f1-bba5-c873076f46b8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:58:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-bd01f3fb-444b-47f1-bba5-c873076f46b8 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" status: 200 len: 1539 microversion: 2.1 time: 0.167736 Apr 14 10:58:05 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 239/708] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:58:04 2023] GET /compute/v2.1/servers/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 => generated 1539 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:58:10 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:10 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=12 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:10 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-b2729157-7dcf-43b0-b6cc-6bc5303b2330 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:58:10 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-b2729157-7dcf-43b0-b6cc-6bc5303b2330 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:58:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b2729157-7dcf-43b0-b6cc-6bc5303b2330 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b2729157-7dcf-43b0-b6cc-6bc5303b2330 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b2729157-7dcf-43b0-b6cc-6bc5303b2330 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b2729157-7dcf-43b0-b6cc-6bc5303b2330 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b2729157-7dcf-43b0-b6cc-6bc5303b2330 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b2729157-7dcf-43b0-b6cc-6bc5303b2330 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:10 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-b2729157-7dcf-43b0-b6cc-6bc5303b2330 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047122 Apr 14 10:58:10 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 235/709] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:58:10 2023] GET /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 10:58:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-336900456"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:14 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:58:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe/action" status: 202 len: 0 microversion: 2.1 time: 0.808920 Apr 14 10:58:14 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 236/710] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 10:58:14 2023] POST /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe/action => generated 0 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 10:58:23 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-809706283", "imageRef": "b87baa1b-a18b-4e25-8812-8e4876470ade", "flavorRef": "42", "key_name": "tempest-TestStampPattern-627373922", "security_groups": [{"name": "tempest-secgroup-smoke-188727685"}], "networks": [{"uuid": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea"}]}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:23 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:23 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG nova.network.neutron [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] validate_networks() for [('1fdeb048-706a-45bf-8f2a-2cee21abb9ea', None, None, None, None, None)] {{(pid=61841) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Flavor limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Image limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Flavor pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Image pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Getting quotas for project f629ba0ab8074ed8bb4e59d545b74eb6. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Getting quotas for user e3ad6531a67b4be58a195e1208157b0b and project f629ba0ab8074ed8bb4e59d545b74eb6. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Going to run 1 instances... {{(pid=61841) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:58:24 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b87baa1b-a18b-4e25-8812-8e4876470ade',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61841) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:58:24 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.551705 Apr 14 10:58:24 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 240/711] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:58:23 2023] POST /compute/v2.1/servers => generated 403 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:58:24 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d773ac53-da71-4542-9238-a06dd930537c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:58:24 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-d773ac53-da71-4542-9238-a06dd930537c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:58:24 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:24 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:24 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-d773ac53-da71-4542-9238-a06dd930537c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ad6531a67b4be58a195e1208157b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629ba0ab8074ed8bb4e59d545b74eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:58:24 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d773ac53-da71-4542-9238-a06dd930537c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656" status: 200 len: 1235 microversion: 2.1 time: 0.131979 Apr 14 10:58:24 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 236/712] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:58:24 2023] GET /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656 => generated 1235 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:58:27 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:27 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:27 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-580fac7d-8955-4772-854c-1d829b588cab req-7bd90ac9-b02d-4d62-baa3-9da766025481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6a53c3-6e32-456c-a056-fbf1bef3b656", "tag": "c18cf2ba-f230-4684-a95c-14af689d7981"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-580fac7d-8955-4772-854c-1d829b588cab req-7bd90ac9-b02d-4d62-baa3-9da766025481 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-580fac7d-8955-4772-854c-1d829b588cab req-7bd90ac9-b02d-4d62-baa3-9da766025481 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-580fac7d-8955-4772-854c-1d829b588cab req-7bd90ac9-b02d-4d62-baa3-9da766025481 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:27 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-580fac7d-8955-4772-854c-1d829b588cab req-7bd90ac9-b02d-4d62-baa3-9da766025481 service nova] Creating event network-changed:c18cf2ba-f230-4684-a95c-14af689d7981 for instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 on user Apr 14 10:58:27 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-580fac7d-8955-4772-854c-1d829b588cab req-7bd90ac9-b02d-4d62-baa3-9da766025481 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036831 Apr 14 10:58:27 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 237/713] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:58:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:58:29 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-e89db5e2-12da-4685-b08a-2768b509d8a6 req-ee7bc7b2-d403-4a12-8ca3-cdbd94462ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6a53c3-6e32-456c-a056-fbf1bef3b656", "name": "network-vif-plugged", "status": "completed", "tag": "c18cf2ba-f230-4684-a95c-14af689d7981"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e89db5e2-12da-4685-b08a-2768b509d8a6 req-ee7bc7b2-d403-4a12-8ca3-cdbd94462ce7 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e89db5e2-12da-4685-b08a-2768b509d8a6 req-ee7bc7b2-d403-4a12-8ca3-cdbd94462ce7 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:29 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e89db5e2-12da-4685-b08a-2768b509d8a6 req-ee7bc7b2-d403-4a12-8ca3-cdbd94462ce7 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:29 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-e89db5e2-12da-4685-b08a-2768b509d8a6 req-ee7bc7b2-d403-4a12-8ca3-cdbd94462ce7 service nova] Creating event network-vif-plugged:c18cf2ba-f230-4684-a95c-14af689d7981 for instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 on user Apr 14 10:58:29 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-e89db5e2-12da-4685-b08a-2768b509d8a6 req-ee7bc7b2-d403-4a12-8ca3-cdbd94462ce7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033517 Apr 14 10:58:29 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 241/714] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:58:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:58:31 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-b71d2559-3467-4812-a4b9-2d90813c7e88 req-f4f35a82-cf35-47cf-9fdd-9665057b5acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6a53c3-6e32-456c-a056-fbf1bef3b656", "name": "network-vif-plugged", "status": "completed", "tag": "c18cf2ba-f230-4684-a95c-14af689d7981"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b71d2559-3467-4812-a4b9-2d90813c7e88 req-f4f35a82-cf35-47cf-9fdd-9665057b5acc service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b71d2559-3467-4812-a4b9-2d90813c7e88 req-f4f35a82-cf35-47cf-9fdd-9665057b5acc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b71d2559-3467-4812-a4b9-2d90813c7e88 req-f4f35a82-cf35-47cf-9fdd-9665057b5acc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:31 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-b71d2559-3467-4812-a4b9-2d90813c7e88 req-f4f35a82-cf35-47cf-9fdd-9665057b5acc service nova] Creating event network-vif-plugged:c18cf2ba-f230-4684-a95c-14af689d7981 for instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 on user Apr 14 10:58:31 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-b71d2559-3467-4812-a4b9-2d90813c7e88 req-f4f35a82-cf35-47cf-9fdd-9665057b5acc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027381 Apr 14 10:58:31 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 237/715] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:58:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:58:39 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:39 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:39 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-6197917c-2ab8-43b0-8dcf-9bb6965feb8f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:58:39 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-6197917c-2ab8-43b0-8dcf-9bb6965feb8f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:58:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6197917c-2ab8-43b0-8dcf-9bb6965feb8f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6197917c-2ab8-43b0-8dcf-9bb6965feb8f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6197917c-2ab8-43b0-8dcf-9bb6965feb8f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6197917c-2ab8-43b0-8dcf-9bb6965feb8f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6197917c-2ab8-43b0-8dcf-9bb6965feb8f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6197917c-2ab8-43b0-8dcf-9bb6965feb8f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:39 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-6197917c-2ab8-43b0-8dcf-9bb6965feb8f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:58:39 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-6197917c-2ab8-43b0-8dcf-9bb6965feb8f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e" status: 200 len: 1537 microversion: 2.1 time: 0.226054 Apr 14 10:58:39 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 238/716] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:58:39 2023] GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e => generated 1537 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:58:40 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:40 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:40 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:40 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-682c9d37-060d-4963-a1bd-1804583b6bcd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:58:40 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-682c9d37-060d-4963-a1bd-1804583b6bcd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:58:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-682c9d37-060d-4963-a1bd-1804583b6bcd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-682c9d37-060d-4963-a1bd-1804583b6bcd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-682c9d37-060d-4963-a1bd-1804583b6bcd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-682c9d37-060d-4963-a1bd-1804583b6bcd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-682c9d37-060d-4963-a1bd-1804583b6bcd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-682c9d37-060d-4963-a1bd-1804583b6bcd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-682c9d37-060d-4963-a1bd-1804583b6bcd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] HTTP exception thrown: Instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 could not be found. Apr 14 10:58:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-682c9d37-060d-4963-a1bd-1804583b6bcd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Request method failure captured: Apr 14 10:58:40 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 HTTP/1.1 Apr 14 10:58:40 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:58:40 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:58:40 user devstack@n-api.service[61841]: Connection: close Apr 14 10:58:40 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 10:58:40 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:58:40 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:58:40 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:58:40 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:58:40 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4ehvfPZmc6Cn8y_nUIgKmNt1MynNk1Jx9BkLUufz1O66F8ryB_RqLkjS4mqbIJCUIPkzgHXdvu3Dcwu4qkkSxSHHlhjBDdWlDUtyfTJIWQwoe_fVC9Grh5B2CbrOSLWshhTkM317x0-K8crYQxMYn74sVjwEj0iqM8tWzpqn1eQII Apr 14 10:58:40 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:58:40 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:58:40 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:58:40 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:58:40 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:58:40 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:58:40 user devstack@n-api.service[61841]: X-Project-Id: bf93e5dac50342d0b65ef09711401e99 Apr 14 10:58:40 user devstack@n-api.service[61841]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-563868574 Apr 14 10:58:40 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:58:40 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:58:40 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf93e5dac50342d0b65ef09711401e99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf93e5dac50342d0b65ef09711401e99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf93e5dac50342d0b65ef09711401e99"}]}] Apr 14 10:58:40 user devstack@n-api.service[61841]: X-Tenant: tempest-ServerRescueNegativeTestJSON-563868574 Apr 14 10:58:40 user devstack@n-api.service[61841]: X-Tenant-Id: bf93e5dac50342d0b65ef09711401e99 Apr 14 10:58:40 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-563868574 Apr 14 10:58:40 user devstack@n-api.service[61841]: X-User: tempest-ServerRescueNegativeTestJSON-563868574-project-member Apr 14 10:58:40 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:58:40 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:58:40 user devstack@n-api.service[61841]: X-User-Id: e359578dcbb24755a216415053d415ef Apr 14 10:58:40 user devstack@n-api.service[61841]: X-User-Name: tempest-ServerRescueNegativeTestJSON-563868574-project-member Apr 14 10:58:40 user devstack@n-api.service[61841]: method: > Apr 14 10:58:40 user devstack@n-api.service[61841]: exception: Instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 could not be found. Apr 14 10:58:40 user devstack@n-api.service[61841]: action_args: {'id': 'd8e00388-b9f1-4c73-ad0a-3a1c8e0207d5'} Apr 14 10:58:40 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 could not be found. Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 could not be found. Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 could not be found. Apr 14 10:58:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:58:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-682c9d37-060d-4963-a1bd-1804583b6bcd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Returning 404 to user: Instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:58:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-682c9d37-060d-4963-a1bd-1804583b6bcd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" status: 404 len: 111 microversion: 2.1 time: 0.097944 Apr 14 10:58:40 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 242/717] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:58:40 2023] GET /compute/v2.1/servers/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:58:40 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-70a4e766-1de1-4635-a369-84a2c5f8b6b6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '.version_select at 0x7fcd1ce45510>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:58:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-70a4e766-1de1-4635-a369-84a2c5f8b6b6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550009007" status: 202 len: 0 microversion: 2.1 time: 0.031717 Apr 14 10:58:40 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 238/718] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 10:58:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550009007 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:58:44 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-594439a5-bbb6-41d4-947d-34be66ab111e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:58:44 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-594439a5-bbb6-41d4-947d-34be66ab111e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:58:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-594439a5-bbb6-41d4-947d-34be66ab111e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-594439a5-bbb6-41d4-947d-34be66ab111e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-594439a5-bbb6-41d4-947d-34be66ab111e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-594439a5-bbb6-41d4-947d-34be66ab111e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-594439a5-bbb6-41d4-947d-34be66ab111e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-594439a5-bbb6-41d4-947d-34be66ab111e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:44 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-594439a5-bbb6-41d4-947d-34be66ab111e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:58:44 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-594439a5-bbb6-41d4-947d-34be66ab111e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94" status: 200 len: 1545 microversion: 2.1 time: 0.182429 Apr 14 10:58:44 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 239/719] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:58:44 2023] GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94 => generated 1545 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:58:46 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:58:46 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:58:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:46 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:58:46 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba" status: 204 len: 0 microversion: 2.1 time: 0.143570 Apr 14 10:58:46 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 243/720] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:58:46 2023] DELETE /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:58:46 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:46 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-3d336bba-e5cc-4513-bdd9-92dfefe11d69 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:58:46 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-3d336bba-e5cc-4513-bdd9-92dfefe11d69 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:58:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3d336bba-e5cc-4513-bdd9-92dfefe11d69 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3d336bba-e5cc-4513-bdd9-92dfefe11d69 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3d336bba-e5cc-4513-bdd9-92dfefe11d69 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3d336bba-e5cc-4513-bdd9-92dfefe11d69 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3d336bba-e5cc-4513-bdd9-92dfefe11d69 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3d336bba-e5cc-4513-bdd9-92dfefe11d69 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:46 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-3d336bba-e5cc-4513-bdd9-92dfefe11d69 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f2157c5d4d441db80ea4a3ca60e4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1c0764b8a843808158644eb90704e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:58:46 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-3d336bba-e5cc-4513-bdd9-92dfefe11d69 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba" status: 200 len: 1499 microversion: 2.1 time: 0.359812 Apr 14 10:58:46 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 239/721] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:58:46 2023] GET /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba => generated 1499 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:58:47 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-fa73b4aa-d915-4d3e-b1a9-82ff39b36640 req-0dc21684-e962-46eb-8852-0b64d4ce5148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade9eacb-d4f9-406d-85c4-043037a4b6ba", "name": "network-vif-unplugged", "status": "completed", "tag": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-fa73b4aa-d915-4d3e-b1a9-82ff39b36640 req-0dc21684-e962-46eb-8852-0b64d4ce5148 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-fa73b4aa-d915-4d3e-b1a9-82ff39b36640 req-0dc21684-e962-46eb-8852-0b64d4ce5148 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-fa73b4aa-d915-4d3e-b1a9-82ff39b36640 req-0dc21684-e962-46eb-8852-0b64d4ce5148 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:47 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-fa73b4aa-d915-4d3e-b1a9-82ff39b36640 req-0dc21684-e962-46eb-8852-0b64d4ce5148 service nova] Creating event network-vif-unplugged:2d3b8886-7cd5-44ff-a36d-e576e7b0eabb for instance ade9eacb-d4f9-406d-85c4-043037a4b6ba on user Apr 14 10:58:47 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-fa73b4aa-d915-4d3e-b1a9-82ff39b36640 req-0dc21684-e962-46eb-8852-0b64d4ce5148 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100270 Apr 14 10:58:47 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 240/722] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:58:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 10:58:47 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-964379fc-b09c-4e01-892b-e2ac1f91b204 req-506ce345-b0f1-4469-9b24-b563f4b9a4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade9eacb-d4f9-406d-85c4-043037a4b6ba", "name": "network-vif-deleted", "tag": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-964379fc-b09c-4e01-892b-e2ac1f91b204 req-506ce345-b0f1-4469-9b24-b563f4b9a4e9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-964379fc-b09c-4e01-892b-e2ac1f91b204 req-506ce345-b0f1-4469-9b24-b563f4b9a4e9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-964379fc-b09c-4e01-892b-e2ac1f91b204 req-506ce345-b0f1-4469-9b24-b563f4b9a4e9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:47 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-964379fc-b09c-4e01-892b-e2ac1f91b204 req-506ce345-b0f1-4469-9b24-b563f4b9a4e9 service nova] Creating event network-vif-deleted:2d3b8886-7cd5-44ff-a36d-e576e7b0eabb for instance ade9eacb-d4f9-406d-85c4-043037a4b6ba on user Apr 14 10:58:47 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-964379fc-b09c-4e01-892b-e2ac1f91b204 req-506ce345-b0f1-4469-9b24-b563f4b9a4e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034226 Apr 14 10:58:47 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 244/723] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:58:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:58:48 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1915851503", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "048ec0ee-0465-448d-8b4c-f072acb101dc", "destination_type": "volume"}], "networks": [{"uuid": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8"}]}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:48 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] validate_networks() for [('07f1f39e-292a-4e73-b4ed-99e5799d6fa8', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:58:49 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-60d06d05-a465-41b8-b4ab-3c56aaf65dfe req-2dcaf530-c0b4-4b69-b201-6a752bf0233d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade9eacb-d4f9-406d-85c4-043037a4b6ba", "name": "network-vif-plugged", "status": "completed", "tag": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-60d06d05-a465-41b8-b4ab-3c56aaf65dfe req-2dcaf530-c0b4-4b69-b201-6a752bf0233d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-60d06d05-a465-41b8-b4ab-3c56aaf65dfe req-2dcaf530-c0b4-4b69-b201-6a752bf0233d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-60d06d05-a465-41b8-b4ab-3c56aaf65dfe req-2dcaf530-c0b4-4b69-b201-6a752bf0233d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:49 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-60d06d05-a465-41b8-b4ab-3c56aaf65dfe req-2dcaf530-c0b4-4b69-b201-6a752bf0233d service nova] Creating event network-vif-plugged:2d3b8886-7cd5-44ff-a36d-e576e7b0eabb for instance ade9eacb-d4f9-406d-85c4-043037a4b6ba on user Apr 14 10:58:49 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-60d06d05-a465-41b8-b4ab-3c56aaf65dfe req-2dcaf530-c0b4-4b69-b201-6a752bf0233d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030629 Apr 14 10:58:49 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 241/724] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:58:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting quotas for project 71289f80a05141f482cb538dac3d7b38. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting quotas for user 395bc9d7007c4e01ac7effd418bcea19 and project 71289f80a05141f482cb538dac3d7b38. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:58:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.513762 Apr 14 10:58:49 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 240/725] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 10:58:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 10:58:49 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-b85f09fc-a325-41f6-bdd2-5dba315509d0 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:58:49 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-b85f09fc-a325-41f6-bdd2-5dba315509d0 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:58:49 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-b85f09fc-a325-41f6-bdd2-5dba315509d0 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:58:49 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-b85f09fc-a325-41f6-bdd2-5dba315509d0 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:58:49 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-b85f09fc-a325-41f6-bdd2-5dba315509d0 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:58:49 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-b85f09fc-a325-41f6-bdd2-5dba315509d0 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177" status: 200 len: 1395 microversion: 2.87 time: 0.084794 Apr 14 10:58:49 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 245/726] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:58:49 2023] GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177 => generated 1395 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:58:49 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:58:49 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:58:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:49 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:58:49 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a" status: 204 len: 0 microversion: 2.1 time: 0.155787 Apr 14 10:58:49 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 242/727] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:58:49 2023] DELETE /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-7c090d4a-582c-40d9-b32b-59943c230fcf tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-7c090d4a-582c-40d9-b32b-59943c230fcf tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7c090d4a-582c-40d9-b32b-59943c230fcf tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7c090d4a-582c-40d9-b32b-59943c230fcf tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7c090d4a-582c-40d9-b32b-59943c230fcf tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7c090d4a-582c-40d9-b32b-59943c230fcf tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7c090d4a-582c-40d9-b32b-59943c230fcf tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7c090d4a-582c-40d9-b32b-59943c230fcf tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:50 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-7c090d4a-582c-40d9-b32b-59943c230fcf tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:58:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-7c090d4a-582c-40d9-b32b-59943c230fcf tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a" status: 200 len: 1494 microversion: 2.1 time: 0.306242 Apr 14 10:58:50 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 241/728] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:58:49 2023] GET /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a => generated 1494 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:58:51 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97820f17-22d1-4ec3-9721-1edadccc794a", "name": "network-vif-unplugged", "status": "completed", "tag": "dea3830d-9f49-4d5e-953b-eec2ee969b02"}, {"server_uuid": "97820f17-22d1-4ec3-9721-1edadccc794a", "name": "network-vif-plugged", "status": "completed", "tag": "dea3830d-9f49-4d5e-953b-eec2ee969b02"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:51 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] Creating event network-vif-unplugged:dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance 97820f17-22d1-4ec3-9721-1edadccc794a on user Apr 14 10:58:51 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] Creating event network-vif-plugged:dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance 97820f17-22d1-4ec3-9721-1edadccc794a on user Apr 14 10:58:51 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030446 Apr 14 10:58:51 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 246/729] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:58:51 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:58:51 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-88cb3257-8b15-41a0-8274-d5614ba9e364 req-58055a9f-0c34-48c2-ae35-d5dc4847b315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97820f17-22d1-4ec3-9721-1edadccc794a", "name": "network-vif-deleted", "tag": "dea3830d-9f49-4d5e-953b-eec2ee969b02"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-88cb3257-8b15-41a0-8274-d5614ba9e364 req-58055a9f-0c34-48c2-ae35-d5dc4847b315 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-88cb3257-8b15-41a0-8274-d5614ba9e364 req-58055a9f-0c34-48c2-ae35-d5dc4847b315 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-88cb3257-8b15-41a0-8274-d5614ba9e364 req-58055a9f-0c34-48c2-ae35-d5dc4847b315 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:51 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-88cb3257-8b15-41a0-8274-d5614ba9e364 req-58055a9f-0c34-48c2-ae35-d5dc4847b315 service nova] Creating event network-vif-deleted:dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance 97820f17-22d1-4ec3-9721-1edadccc794a on user Apr 14 10:58:51 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-88cb3257-8b15-41a0-8274-d5614ba9e364 req-58055a9f-0c34-48c2-ae35-d5dc4847b315 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033787 Apr 14 10:58:51 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 243/730] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:58:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:58:53 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-f861e460-710a-428e-bd9f-a1ddcedbda95 req-2c4f3c47-fa0c-4add-9db4-5cdff7d92224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbcca78c-fe73-4ef1-92f9-4c8061cad177", "tag": "845cc40f-1b03-4b85-8d19-fea731fe7f89"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f861e460-710a-428e-bd9f-a1ddcedbda95 req-2c4f3c47-fa0c-4add-9db4-5cdff7d92224 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f861e460-710a-428e-bd9f-a1ddcedbda95 req-2c4f3c47-fa0c-4add-9db4-5cdff7d92224 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f861e460-710a-428e-bd9f-a1ddcedbda95 req-2c4f3c47-fa0c-4add-9db4-5cdff7d92224 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-f861e460-710a-428e-bd9f-a1ddcedbda95 req-2c4f3c47-fa0c-4add-9db4-5cdff7d92224 service nova] Creating event network-changed:845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 on user Apr 14 10:58:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-f861e460-710a-428e-bd9f-a1ddcedbda95 req-2c4f3c47-fa0c-4add-9db4-5cdff7d92224 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036762 Apr 14 10:58:53 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 242/731] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:58:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:58:57 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-27b3a51b-2334-40c6-80e2-afae81f23491 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:58:57 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-27b3a51b-2334-40c6-80e2-afae81f23491 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:58:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-27b3a51b-2334-40c6-80e2-afae81f23491 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-27b3a51b-2334-40c6-80e2-afae81f23491 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-27b3a51b-2334-40c6-80e2-afae81f23491 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-27b3a51b-2334-40c6-80e2-afae81f23491 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-27b3a51b-2334-40c6-80e2-afae81f23491 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-27b3a51b-2334-40c6-80e2-afae81f23491 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:57 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-27b3a51b-2334-40c6-80e2-afae81f23491 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046864 Apr 14 10:58:57 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 247/732] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 10:58:56 2023] GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:58:57 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:58:57 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:58:57 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:57 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:57 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:57 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:57 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:57 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:57 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:58:57 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" status: 204 len: 0 microversion: 2.20 time: 0.457766 Apr 14 10:58:57 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 244/733] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 10:58:57 2023] DELETE /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 10:58:57 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-dc28054d-12d2-4ded-96fe-482d3c622ee0 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:58:57 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-dc28054d-12d2-4ded-96fe-482d3c622ee0 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:58:57 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:58:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dc28054d-12d2-4ded-96fe-482d3c622ee0 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dc28054d-12d2-4ded-96fe-482d3c622ee0 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dc28054d-12d2-4ded-96fe-482d3c622ee0 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dc28054d-12d2-4ded-96fe-482d3c622ee0 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dc28054d-12d2-4ded-96fe-482d3c622ee0 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dc28054d-12d2-4ded-96fe-482d3c622ee0 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:57 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-dc28054d-12d2-4ded-96fe-482d3c622ee0 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:58:57 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-dc28054d-12d2-4ded-96fe-482d3c622ee0 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:58:57 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-dc28054d-12d2-4ded-96fe-482d3c622ee0 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:58:57 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-dc28054d-12d2-4ded-96fe-482d3c622ee0 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" status: 200 len: 1711 microversion: 2.20 time: 0.155627 Apr 14 10:58:57 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 243/734] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:58:57 2023] GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => generated 1711 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:58:58 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-6a531573-a405-41e4-bb64-a0ce3738f879 req-b247fb0f-3e41-4d96-805d-8930c4bf71df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387", "name": "network-vif-unplugged", "status": "completed", "tag": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6a531573-a405-41e4-bb64-a0ce3738f879 req-b247fb0f-3e41-4d96-805d-8930c4bf71df service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6a531573-a405-41e4-bb64-a0ce3738f879 req-b247fb0f-3e41-4d96-805d-8930c4bf71df service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6a531573-a405-41e4-bb64-a0ce3738f879 req-b247fb0f-3e41-4d96-805d-8930c4bf71df service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:58 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-6a531573-a405-41e4-bb64-a0ce3738f879 req-b247fb0f-3e41-4d96-805d-8930c4bf71df service nova] Creating event network-vif-unplugged:1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 on user Apr 14 10:58:58 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-6a531573-a405-41e4-bb64-a0ce3738f879 req-b247fb0f-3e41-4d96-805d-8930c4bf71df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028608 Apr 14 10:58:58 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 248/735] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:58:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:58:59 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-4dbc3b2a-75a2-4ad0-b406-3c5425c30204 req-7bf964fe-bbf9-4e71-a226-33c0c4431e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387", "name": "network-vif-deleted", "tag": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:58:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4dbc3b2a-75a2-4ad0-b406-3c5425c30204 req-7bf964fe-bbf9-4e71-a226-33c0c4431e3a service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:58:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4dbc3b2a-75a2-4ad0-b406-3c5425c30204 req-7bf964fe-bbf9-4e71-a226-33c0c4431e3a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:58:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4dbc3b2a-75a2-4ad0-b406-3c5425c30204 req-7bf964fe-bbf9-4e71-a226-33c0c4431e3a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:58:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-4dbc3b2a-75a2-4ad0-b406-3c5425c30204 req-7bf964fe-bbf9-4e71-a226-33c0c4431e3a service nova] Creating event network-vif-deleted:1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 on user Apr 14 10:58:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-4dbc3b2a-75a2-4ad0-b406-3c5425c30204 req-7bf964fe-bbf9-4e71-a226-33c0c4431e3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040589 Apr 14 10:58:59 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 245/736] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:58:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:00 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-87e8c875-32dd-41c3-9447-2bd5a1aa378c req-2d5abb4f-898f-4abc-8f01-5495e2bfd3e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387", "name": "network-vif-plugged", "status": "completed", "tag": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:00 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:00 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-87e8c875-32dd-41c3-9447-2bd5a1aa378c req-2d5abb4f-898f-4abc-8f01-5495e2bfd3e5 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-87e8c875-32dd-41c3-9447-2bd5a1aa378c req-2d5abb4f-898f-4abc-8f01-5495e2bfd3e5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:00 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-87e8c875-32dd-41c3-9447-2bd5a1aa378c req-2d5abb4f-898f-4abc-8f01-5495e2bfd3e5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:00 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-87e8c875-32dd-41c3-9447-2bd5a1aa378c req-2d5abb4f-898f-4abc-8f01-5495e2bfd3e5 service nova] Creating event network-vif-plugged:1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 on user Apr 14 10:59:00 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-87e8c875-32dd-41c3-9447-2bd5a1aa378c req-2d5abb4f-898f-4abc-8f01-5495e2bfd3e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038423 Apr 14 10:59:00 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 244/737] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:59:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:03 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:03 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-7fee115c-b35d-4055-a2ac-b15106a26232 req-7d005d80-6f42-4033-9187-2842e9a13872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcca78c-fe73-4ef1-92f9-4c8061cad177", "name": "network-vif-plugged", "status": "completed", "tag": "845cc40f-1b03-4b85-8d19-fea731fe7f89"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7fee115c-b35d-4055-a2ac-b15106a26232 req-7d005d80-6f42-4033-9187-2842e9a13872 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7fee115c-b35d-4055-a2ac-b15106a26232 req-7d005d80-6f42-4033-9187-2842e9a13872 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-7fee115c-b35d-4055-a2ac-b15106a26232 req-7d005d80-6f42-4033-9187-2842e9a13872 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:04 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-7fee115c-b35d-4055-a2ac-b15106a26232 req-7d005d80-6f42-4033-9187-2842e9a13872 service nova] Creating event network-vif-plugged:845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 on user Apr 14 10:59:04 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-7fee115c-b35d-4055-a2ac-b15106a26232 req-7d005d80-6f42-4033-9187-2842e9a13872 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030780 Apr 14 10:59:04 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 249/738] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:59:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:05 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-dfecf3f8-2c60-4b80-a8d8-a05480861155 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:05 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-dfecf3f8-2c60-4b80-a8d8-a05480861155 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dfecf3f8-2c60-4b80-a8d8-a05480861155 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dfecf3f8-2c60-4b80-a8d8-a05480861155 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dfecf3f8-2c60-4b80-a8d8-a05480861155 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dfecf3f8-2c60-4b80-a8d8-a05480861155 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dfecf3f8-2c60-4b80-a8d8-a05480861155 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dfecf3f8-2c60-4b80-a8d8-a05480861155 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:05 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-dfecf3f8-2c60-4b80-a8d8-a05480861155 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.140823 Apr 14 10:59:05 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 246/739] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 10:59:05 2023] GET /compute/v2.1/servers/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/os-interface => generated 282 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:06 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-ebd06c09-40f6-4de9-a6e1-7af93309d846 req-97ef8c93-e8a1-4d45-8614-c8398bfa20e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcca78c-fe73-4ef1-92f9-4c8061cad177", "name": "network-vif-plugged", "status": "completed", "tag": "845cc40f-1b03-4b85-8d19-fea731fe7f89"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:06 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-be996d6f-9078-454c-bbc8-9fd92a232794 req-7649b748-0efd-4cfa-9fdb-79864ef1d9bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7", "tag": "ec941aab-7c95-415b-96bc-e74ebaeb9385"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:06 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ebd06c09-40f6-4de9-a6e1-7af93309d846 req-97ef8c93-e8a1-4d45-8614-c8398bfa20e2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:06 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ebd06c09-40f6-4de9-a6e1-7af93309d846 req-97ef8c93-e8a1-4d45-8614-c8398bfa20e2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:06 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ebd06c09-40f6-4de9-a6e1-7af93309d846 req-97ef8c93-e8a1-4d45-8614-c8398bfa20e2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-be996d6f-9078-454c-bbc8-9fd92a232794 req-7649b748-0efd-4cfa-9fdb-79864ef1d9bc service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-be996d6f-9078-454c-bbc8-9fd92a232794 req-7649b748-0efd-4cfa-9fdb-79864ef1d9bc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:06 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-be996d6f-9078-454c-bbc8-9fd92a232794 req-7649b748-0efd-4cfa-9fdb-79864ef1d9bc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:06 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-ebd06c09-40f6-4de9-a6e1-7af93309d846 req-97ef8c93-e8a1-4d45-8614-c8398bfa20e2 service nova] Creating event network-vif-plugged:845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 on user Apr 14 10:59:06 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-ebd06c09-40f6-4de9-a6e1-7af93309d846 req-97ef8c93-e8a1-4d45-8614-c8398bfa20e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040158 Apr 14 10:59:06 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 250/740] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:59:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:06 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-be996d6f-9078-454c-bbc8-9fd92a232794 req-7649b748-0efd-4cfa-9fdb-79864ef1d9bc service nova] Creating event network-changed:ec941aab-7c95-415b-96bc-e74ebaeb9385 for instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 on user Apr 14 10:59:06 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-be996d6f-9078-454c-bbc8-9fd92a232794 req-7649b748-0efd-4cfa-9fdb-79864ef1d9bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096469 Apr 14 10:59:06 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 245/741] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:59:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:09 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1613655632", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "18a91434-637b-4c19-a97b-736b32c1ea5a"}], "security_groups": [{"name": "tempest-securitygroup--494137881"}], "key_name": "tempest-keypair-1544270235", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "64198cbd-5b4a-4ca5-bb06-b6553335edb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:09 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] validate_networks() for [('18a91434-637b-4c19-a97b-736b32c1ea5a', None, None, None, None, None)] {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting quotas for project 3ea2cb4dfa5b4a52b658efd8f5aefb36. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting quotas for user 5873a358bf544691b12cd2979f5e36dc and project 3ea2cb4dfa5b4a52b658efd8f5aefb36. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 10:59:10 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='64198cbd-5b4a-4ca5-bb06-b6553335edb3',volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 10:59:10 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.751148 Apr 14 10:59:10 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 247/742] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 10:59:09 2023] POST /compute/v2.1/servers => generated 403 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 10:59:10 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-8023dbdb-7c27-4317-a3c1-b6a2734b23e4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:10 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-8023dbdb-7c27-4317-a3c1-b6a2734b23e4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:10 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:10 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-8023dbdb-7c27-4317-a3c1-b6a2734b23e4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:59:10 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-8023dbdb-7c27-4317-a3c1-b6a2734b23e4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e" status: 200 len: 1076 microversion: 2.1 time: 0.069949 Apr 14 10:59:10 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 251/743] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:59:10 2023] GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e => generated 1076 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:59:13 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-e1a1d86b-b067-41da-8670-b45fee9697e5 req-5b9ad1d7-ba5e-45ef-9f21-b2598b038d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db2e71c-939b-4d2f-b1be-c2122f7cd73e", "tag": "1e547ec7-7efd-480f-84be-806c8cf25b90"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-e1a1d86b-b067-41da-8670-b45fee9697e5 req-5b9ad1d7-ba5e-45ef-9f21-b2598b038d65 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-e1a1d86b-b067-41da-8670-b45fee9697e5 req-5b9ad1d7-ba5e-45ef-9f21-b2598b038d65 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-e1a1d86b-b067-41da-8670-b45fee9697e5 req-5b9ad1d7-ba5e-45ef-9f21-b2598b038d65 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:13 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-e1a1d86b-b067-41da-8670-b45fee9697e5 req-5b9ad1d7-ba5e-45ef-9f21-b2598b038d65 service nova] Creating event network-changed:1e547ec7-7efd-480f-84be-806c8cf25b90 for instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e on user Apr 14 10:59:13 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-e1a1d86b-b067-41da-8670-b45fee9697e5 req-5b9ad1d7-ba5e-45ef-9f21-b2598b038d65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033102 Apr 14 10:59:13 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 246/744] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:59:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8a6e61f0-138b-4faa-98ea-d34080eed896 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:14 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-8a6e61f0-138b-4faa-98ea-d34080eed896 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8a6e61f0-138b-4faa-98ea-d34080eed896 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8a6e61f0-138b-4faa-98ea-d34080eed896 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8a6e61f0-138b-4faa-98ea-d34080eed896 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8a6e61f0-138b-4faa-98ea-d34080eed896 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8a6e61f0-138b-4faa-98ea-d34080eed896 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8a6e61f0-138b-4faa-98ea-d34080eed896 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:14 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-8a6e61f0-138b-4faa-98ea-d34080eed896 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ad6531a67b4be58a195e1208157b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629ba0ab8074ed8bb4e59d545b74eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:59:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-8a6e61f0-138b-4faa-98ea-d34080eed896 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656" status: 200 len: 1536 microversion: 2.1 time: 0.157656 Apr 14 10:59:14 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 248/745] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:59:14 2023] GET /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656 => generated 1536 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:59:19 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-5ede43f3-92e2-432f-8b3b-2ef983919b5e req-c79c4ab3-d4ee-4a12-820e-2bc0542d50c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db2e71c-939b-4d2f-b1be-c2122f7cd73e", "name": "network-vif-plugged", "status": "completed", "tag": "1e547ec7-7efd-480f-84be-806c8cf25b90"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:19 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5ede43f3-92e2-432f-8b3b-2ef983919b5e req-c79c4ab3-d4ee-4a12-820e-2bc0542d50c6 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5ede43f3-92e2-432f-8b3b-2ef983919b5e req-c79c4ab3-d4ee-4a12-820e-2bc0542d50c6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5ede43f3-92e2-432f-8b3b-2ef983919b5e req-c79c4ab3-d4ee-4a12-820e-2bc0542d50c6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:19 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-5ede43f3-92e2-432f-8b3b-2ef983919b5e req-c79c4ab3-d4ee-4a12-820e-2bc0542d50c6 service nova] Creating event network-vif-plugged:1e547ec7-7efd-480f-84be-806c8cf25b90 for instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e on user Apr 14 10:59:19 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-5ede43f3-92e2-432f-8b3b-2ef983919b5e req-c79c4ab3-d4ee-4a12-820e-2bc0542d50c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037252 Apr 14 10:59:19 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 252/746] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:59:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-4a1d1596-3afb-42b5-9767-450fa1b59fc4 req-96066298-4723-4039-9846-3bdfe72aed64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db2e71c-939b-4d2f-b1be-c2122f7cd73e", "name": "network-vif-plugged", "status": "completed", "tag": "1e547ec7-7efd-480f-84be-806c8cf25b90"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-4a1d1596-3afb-42b5-9767-450fa1b59fc4 req-96066298-4723-4039-9846-3bdfe72aed64 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-4a1d1596-3afb-42b5-9767-450fa1b59fc4 req-96066298-4723-4039-9846-3bdfe72aed64 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-4a1d1596-3afb-42b5-9767-450fa1b59fc4 req-96066298-4723-4039-9846-3bdfe72aed64 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:21 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=29 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:21 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-4a1d1596-3afb-42b5-9767-450fa1b59fc4 req-96066298-4723-4039-9846-3bdfe72aed64 service nova] Creating event network-vif-plugged:1e547ec7-7efd-480f-84be-806c8cf25b90 for instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e on user Apr 14 10:59:21 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-4a1d1596-3afb-42b5-9767-450fa1b59fc4 req-96066298-4723-4039-9846-3bdfe72aed64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029739 Apr 14 10:59:21 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 247/747] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:59:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:36 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:36 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:36 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:36 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=7 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:36 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8d469756-7fac-4e39-974a-13388352c8d0 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:36 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-8d469756-7fac-4e39-974a-13388352c8d0 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:36 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d469756-7fac-4e39-974a-13388352c8d0 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:36 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d469756-7fac-4e39-974a-13388352c8d0 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:36 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d469756-7fac-4e39-974a-13388352c8d0 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:36 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d469756-7fac-4e39-974a-13388352c8d0 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:36 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d469756-7fac-4e39-974a-13388352c8d0 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:36 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8d469756-7fac-4e39-974a-13388352c8d0 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:36 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-8d469756-7fac-4e39-974a-13388352c8d0 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] HTTP exception thrown: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. Apr 14 10:59:36 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8d469756-7fac-4e39-974a-13388352c8d0 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Request method failure captured: Apr 14 10:59:36 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba HTTP/1.1 Apr 14 10:59:36 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:59:36 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:59:36 user devstack@n-api.service[61839]: Connection: close Apr 14 10:59:36 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:59:36 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:59:36 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:59:36 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:59:36 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:59:36 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTEIFQshLfVvHk6zzMGyR_oC5LUKpIB3AE99vu24J4VUKIZ_I-EwK7Y3I7wnUHCRWCubyFlBrfn9xQqhiAoc3tpsRHBshn37If4FOH70hV1TDB1AZ7SkDOxW_ds35MJgoa5aV2nhuLsDoazuYmrCamSynjx9Vk7fjpVlXk7fFD9b_oc Apr 14 10:59:36 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:59:36 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:59:36 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:59:36 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:59:36 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:59:36 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:59:36 user devstack@n-api.service[61839]: X-Project-Id: be1c0764b8a843808158644eb90704e6 Apr 14 10:59:36 user devstack@n-api.service[61839]: X-Project-Name: tempest-ServersNegativeTestJSON-1472676568 Apr 14 10:59:36 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:59:36 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:59:36 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be1c0764b8a843808158644eb90704e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be1c0764b8a843808158644eb90704e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be1c0764b8a843808158644eb90704e6"}]}] Apr 14 10:59:36 user devstack@n-api.service[61839]: X-Tenant: tempest-ServersNegativeTestJSON-1472676568 Apr 14 10:59:36 user devstack@n-api.service[61839]: X-Tenant-Id: be1c0764b8a843808158644eb90704e6 Apr 14 10:59:36 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1472676568 Apr 14 10:59:36 user devstack@n-api.service[61839]: X-User: tempest-ServersNegativeTestJSON-1472676568-project-member Apr 14 10:59:36 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:59:36 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:59:36 user devstack@n-api.service[61839]: X-User-Id: b3f2157c5d4d441db80ea4a3ca60e4dc Apr 14 10:59:36 user devstack@n-api.service[61839]: X-User-Name: tempest-ServersNegativeTestJSON-1472676568-project-member Apr 14 10:59:36 user devstack@n-api.service[61839]: method: > Apr 14 10:59:36 user devstack@n-api.service[61839]: exception: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. Apr 14 10:59:36 user devstack@n-api.service[61839]: action_args: {'id': 'ade9eacb-d4f9-406d-85c4-043037a4b6ba'} Apr 14 10:59:36 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. Apr 14 10:59:36 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:59:36 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8d469756-7fac-4e39-974a-13388352c8d0 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Returning 404 to user: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:59:36 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-8d469756-7fac-4e39-974a-13388352c8d0 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba" status: 404 len: 111 microversion: 2.1 time: 0.043140 Apr 14 10:59:36 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 249/748] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:59:36 2023] GET /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:59:37 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:37 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=5 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:37 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-31befd66-042f-4dfe-a014-197504035946 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:37 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-31befd66-042f-4dfe-a014-197504035946 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:37 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-31befd66-042f-4dfe-a014-197504035946 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:37 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-31befd66-042f-4dfe-a014-197504035946 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:37 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-31befd66-042f-4dfe-a014-197504035946 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:37 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-31befd66-042f-4dfe-a014-197504035946 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:37 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-31befd66-042f-4dfe-a014-197504035946 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:37 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-31befd66-042f-4dfe-a014-197504035946 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:37 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-31befd66-042f-4dfe-a014-197504035946 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f2157c5d4d441db80ea4a3ca60e4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1c0764b8a843808158644eb90704e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:59:37 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-31befd66-042f-4dfe-a014-197504035946 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96" status: 200 len: 1495 microversion: 2.1 time: 0.156392 Apr 14 10:59:37 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 253/749] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:59:36 2023] GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96 => generated 1495 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:59:39 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=9 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:39 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 10:59:39 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ff5ca1f4-9add-4eb4-bfd7-65f9ecdbba0e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:39 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-ff5ca1f4-9add-4eb4-bfd7-65f9ecdbba0e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:39 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ff5ca1f4-9add-4eb4-bfd7-65f9ecdbba0e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:39 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ff5ca1f4-9add-4eb4-bfd7-65f9ecdbba0e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:39 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ff5ca1f4-9add-4eb4-bfd7-65f9ecdbba0e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:39 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ff5ca1f4-9add-4eb4-bfd7-65f9ecdbba0e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:39 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ff5ca1f4-9add-4eb4-bfd7-65f9ecdbba0e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:39 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ff5ca1f4-9add-4eb4-bfd7-65f9ecdbba0e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:39 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-ff5ca1f4-9add-4eb4-bfd7-65f9ecdbba0e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:59:39 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-ff5ca1f4-9add-4eb4-bfd7-65f9ecdbba0e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:59:39 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-ff5ca1f4-9add-4eb4-bfd7-65f9ecdbba0e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:59:39 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-ff5ca1f4-9add-4eb4-bfd7-65f9ecdbba0e tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177" status: 200 len: 1770 microversion: 2.87 time: 0.161602 Apr 14 10:59:39 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 248/750] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:59:39 2023] GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177 => generated 1770 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 10:59:39 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-878364da-7c35-4ddd-85f7-54027ae8e419 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:39 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-878364da-7c35-4ddd-85f7-54027ae8e419 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-878364da-7c35-4ddd-85f7-54027ae8e419 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-878364da-7c35-4ddd-85f7-54027ae8e419 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-878364da-7c35-4ddd-85f7-54027ae8e419 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-878364da-7c35-4ddd-85f7-54027ae8e419 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-878364da-7c35-4ddd-85f7-54027ae8e419 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-878364da-7c35-4ddd-85f7-54027ae8e419 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:39 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-878364da-7c35-4ddd-85f7-54027ae8e419 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.082220 Apr 14 10:59:39 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 250/751] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 10:59:39 2023] GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-interface => generated 282 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-5a479afe-ae9b-441a-99e0-655b65f4150a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:40 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-5a479afe-ae9b-441a-99e0-655b65f4150a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5a479afe-ae9b-441a-99e0-655b65f4150a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5a479afe-ae9b-441a-99e0-655b65f4150a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5a479afe-ae9b-441a-99e0-655b65f4150a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5a479afe-ae9b-441a-99e0-655b65f4150a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5a479afe-ae9b-441a-99e0-655b65f4150a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5a479afe-ae9b-441a-99e0-655b65f4150a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-5a479afe-ae9b-441a-99e0-655b65f4150a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] HTTP exception thrown: Instance 97820f17-22d1-4ec3-9721-1edadccc794a could not be found. Apr 14 10:59:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-5a479afe-ae9b-441a-99e0-655b65f4150a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Request method failure captured: Apr 14 10:59:40 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a HTTP/1.1 Apr 14 10:59:40 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:59:40 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:59:40 user devstack@n-api.service[61841]: Connection: close Apr 14 10:59:40 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 10:59:40 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:59:40 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:59:40 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:59:40 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:59:40 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4ehvfPZmc6Cn8y_nUIgKmNt1MynNk1Jx9BkLUufz1O66F8ryB_RqLkjS4mqbIJCUIPkzgHXdvu3Dcwu4qkkSxSHHlhjBDdWlDUtyfTJIWQwoe_fVC9Grh5B2CbrOSLWshhTkM317x0-K8crYQxMYn74sVjwEj0iqM8tWzpqn1eQII Apr 14 10:59:40 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:59:40 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:59:40 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:59:40 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:59:40 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:59:40 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:59:40 user devstack@n-api.service[61841]: X-Project-Id: bf93e5dac50342d0b65ef09711401e99 Apr 14 10:59:40 user devstack@n-api.service[61841]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-563868574 Apr 14 10:59:40 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:59:40 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:59:40 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf93e5dac50342d0b65ef09711401e99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf93e5dac50342d0b65ef09711401e99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf93e5dac50342d0b65ef09711401e99"}]}] Apr 14 10:59:40 user devstack@n-api.service[61841]: X-Tenant: tempest-ServerRescueNegativeTestJSON-563868574 Apr 14 10:59:40 user devstack@n-api.service[61841]: X-Tenant-Id: bf93e5dac50342d0b65ef09711401e99 Apr 14 10:59:40 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-563868574 Apr 14 10:59:40 user devstack@n-api.service[61841]: X-User: tempest-ServerRescueNegativeTestJSON-563868574-project-member Apr 14 10:59:40 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:59:40 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:59:40 user devstack@n-api.service[61841]: X-User-Id: e359578dcbb24755a216415053d415ef Apr 14 10:59:40 user devstack@n-api.service[61841]: X-User-Name: tempest-ServerRescueNegativeTestJSON-563868574-project-member Apr 14 10:59:40 user devstack@n-api.service[61841]: method: > Apr 14 10:59:40 user devstack@n-api.service[61841]: exception: Instance 97820f17-22d1-4ec3-9721-1edadccc794a could not be found. Apr 14 10:59:40 user devstack@n-api.service[61841]: action_args: {'id': '97820f17-22d1-4ec3-9721-1edadccc794a'} Apr 14 10:59:40 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97820f17-22d1-4ec3-9721-1edadccc794a could not be found. Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97820f17-22d1-4ec3-9721-1edadccc794a could not be found. Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97820f17-22d1-4ec3-9721-1edadccc794a could not be found. Apr 14 10:59:40 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:59:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-5a479afe-ae9b-441a-99e0-655b65f4150a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Returning 404 to user: Instance 97820f17-22d1-4ec3-9721-1edadccc794a could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:59:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-5a479afe-ae9b-441a-99e0-655b65f4150a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a" status: 404 len: 111 microversion: 2.1 time: 0.029232 Apr 14 10:59:40 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 254/752] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:59:40 2023] GET /compute/v2.1/servers/97820f17-22d1-4ec3-9721-1edadccc794a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 10:59:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:40 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:40 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Going to try to terminate instance {{(pid=61840) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 10:59:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade" status: 204 len: 0 microversion: 2.1 time: 0.125231 Apr 14 10:59:40 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 249/753] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 10:59:40 2023] DELETE /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 10:59:40 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f1b18fa4-862a-4009-9a16-04ad8637eb0e tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:40 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-f1b18fa4-862a-4009-9a16-04ad8637eb0e tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f1b18fa4-862a-4009-9a16-04ad8637eb0e tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f1b18fa4-862a-4009-9a16-04ad8637eb0e tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f1b18fa4-862a-4009-9a16-04ad8637eb0e tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f1b18fa4-862a-4009-9a16-04ad8637eb0e tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f1b18fa4-862a-4009-9a16-04ad8637eb0e tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f1b18fa4-862a-4009-9a16-04ad8637eb0e tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:40 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-f1b18fa4-862a-4009-9a16-04ad8637eb0e tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 10:59:40 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-f1b18fa4-862a-4009-9a16-04ad8637eb0e tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade" status: 200 len: 1509 microversion: 2.1 time: 0.312685 Apr 14 10:59:40 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 251/754] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 10:59:40 2023] GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade => generated 1509 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 10:59:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-3d2843ec-f4d4-4bdb-b7e0-7c77266f49c3 req-2a6d3e92-3484-498d-9998-e9e41513100d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-unplugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-3d2843ec-f4d4-4bdb-b7e0-7c77266f49c3 req-2a6d3e92-3484-498d-9998-e9e41513100d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-3d2843ec-f4d4-4bdb-b7e0-7c77266f49c3 req-2a6d3e92-3484-498d-9998-e9e41513100d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-3d2843ec-f4d4-4bdb-b7e0-7c77266f49c3 req-2a6d3e92-3484-498d-9998-e9e41513100d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-3d2843ec-f4d4-4bdb-b7e0-7c77266f49c3 req-2a6d3e92-3484-498d-9998-e9e41513100d service nova] Creating event network-vif-unplugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:59:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-3d2843ec-f4d4-4bdb-b7e0-7c77266f49c3 req-2a6d3e92-3484-498d-9998-e9e41513100d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029280 Apr 14 10:59:40 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 255/755] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:59:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:41 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-bd9438d0-aef6-4f65-a559-2cab921ee6e6 req-73f65c6f-9444-400b-b6e0-872f0df132b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb99276-64ba-4641-8869-3f35eea2f76e", "tag": "7e4a1964-f2d0-4a4f-81fc-adf97c621209"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-bd9438d0-aef6-4f65-a559-2cab921ee6e6 req-73f65c6f-9444-400b-b6e0-872f0df132b8 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-bd9438d0-aef6-4f65-a559-2cab921ee6e6 req-73f65c6f-9444-400b-b6e0-872f0df132b8 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-bd9438d0-aef6-4f65-a559-2cab921ee6e6 req-73f65c6f-9444-400b-b6e0-872f0df132b8 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-bd9438d0-aef6-4f65-a559-2cab921ee6e6 req-73f65c6f-9444-400b-b6e0-872f0df132b8 service nova] Creating event network-changed:7e4a1964-f2d0-4a4f-81fc-adf97c621209 for instance 0bb99276-64ba-4641-8869-3f35eea2f76e on user Apr 14 10:59:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-bd9438d0-aef6-4f65-a559-2cab921ee6e6 req-73f65c6f-9444-400b-b6e0-872f0df132b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044521 Apr 14 10:59:41 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 250/756] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:59:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:41 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-4ebda52e-3d42-4f31-90e9-733c53dd3fd2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:41 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-4ebda52e-3d42-4f31-90e9-733c53dd3fd2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4ebda52e-3d42-4f31-90e9-733c53dd3fd2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4ebda52e-3d42-4f31-90e9-733c53dd3fd2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4ebda52e-3d42-4f31-90e9-733c53dd3fd2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4ebda52e-3d42-4f31-90e9-733c53dd3fd2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4ebda52e-3d42-4f31-90e9-733c53dd3fd2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4ebda52e-3d42-4f31-90e9-733c53dd3fd2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:41 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-4ebda52e-3d42-4f31-90e9-733c53dd3fd2 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/ips" status: 200 len: 103 microversion: 2.1 time: 0.036469 Apr 14 10:59:41 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 252/757] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 10:59:41 2023] GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/ips => generated 103 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:42 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-98a32554-0837-41b3-89d6-afa2ad706fce req-2dca3081-d5a2-471f-84d0-fa6025631c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-plugged", "status": "completed", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}, {"server_uuid": "97f20661-8b60-439e-b7af-2fc2013c5ade", "name": "network-vif-deleted", "tag": "270b85b0-1832-4118-a8b0-ff784587b58a"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-98a32554-0837-41b3-89d6-afa2ad706fce req-2dca3081-d5a2-471f-84d0-fa6025631c55 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-98a32554-0837-41b3-89d6-afa2ad706fce req-2dca3081-d5a2-471f-84d0-fa6025631c55 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-98a32554-0837-41b3-89d6-afa2ad706fce req-2dca3081-d5a2-471f-84d0-fa6025631c55 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:42 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-98a32554-0837-41b3-89d6-afa2ad706fce req-2dca3081-d5a2-471f-84d0-fa6025631c55 service nova] Creating event network-vif-plugged:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:59:42 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-98a32554-0837-41b3-89d6-afa2ad706fce req-2dca3081-d5a2-471f-84d0-fa6025631c55 service nova] Creating event network-vif-deleted:270b85b0-1832-4118-a8b0-ff784587b58a for instance 97f20661-8b60-439e-b7af-2fc2013c5ade on user Apr 14 10:59:42 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-98a32554-0837-41b3-89d6-afa2ad706fce req-2dca3081-d5a2-471f-84d0-fa6025631c55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047566 Apr 14 10:59:42 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 256/758] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:59:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:43 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7979d4e6-ecf8-4e89-897f-13d8a1a7afdd"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:43 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:43 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256601 Apr 14 10:59:43 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 251/759] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:59:43 2023] POST /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:44 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-341a7d2e-777f-43b7-a57d-ee437128fdba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:44 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-341a7d2e-777f-43b7-a57d-ee437128fdba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-341a7d2e-777f-43b7-a57d-ee437128fdba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-341a7d2e-777f-43b7-a57d-ee437128fdba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-341a7d2e-777f-43b7-a57d-ee437128fdba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-341a7d2e-777f-43b7-a57d-ee437128fdba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-341a7d2e-777f-43b7-a57d-ee437128fdba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-341a7d2e-777f-43b7-a57d-ee437128fdba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:44 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-341a7d2e-777f-43b7-a57d-ee437128fdba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.090579 Apr 14 10:59:44 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 253/760] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 10:59:44 2023] GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94/os-interface => generated 283 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:45 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-ef67670a-491f-4dda-9489-afce0cb14f5f req-16f63d3e-b963-4d3d-94d0-47832420d827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef413492-c781-459e-b99c-46a530034c94", "tag": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ef67670a-491f-4dda-9489-afce0cb14f5f req-16f63d3e-b963-4d3d-94d0-47832420d827 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ef67670a-491f-4dda-9489-afce0cb14f5f req-16f63d3e-b963-4d3d-94d0-47832420d827 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ef67670a-491f-4dda-9489-afce0cb14f5f req-16f63d3e-b963-4d3d-94d0-47832420d827 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:45 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-90b7602a-00aa-4ac4-b145-2490af48b4ae tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:45 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-90b7602a-00aa-4ac4-b145-2490af48b4ae tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:45 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-90b7602a-00aa-4ac4-b145-2490af48b4ae tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:45 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-90b7602a-00aa-4ac4-b145-2490af48b4ae tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:45 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-90b7602a-00aa-4ac4-b145-2490af48b4ae tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:45 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-90b7602a-00aa-4ac4-b145-2490af48b4ae tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:45 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-90b7602a-00aa-4ac4-b145-2490af48b4ae tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:45 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-90b7602a-00aa-4ac4-b145-2490af48b4ae tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:45 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-ef67670a-491f-4dda-9489-afce0cb14f5f req-16f63d3e-b963-4d3d-94d0-47832420d827 service nova] Creating event network-changed:9e57c0d8-8572-4355-b3c0-d2b74196fc0d for instance ef413492-c781-459e-b99c-46a530034c94 on user Apr 14 10:59:45 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-ef67670a-491f-4dda-9489-afce0cb14f5f req-16f63d3e-b963-4d3d-94d0-47832420d827 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048121 Apr 14 10:59:45 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 257/761] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 10:59:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:45 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-90b7602a-00aa-4ac4-b145-2490af48b4ae tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94/ips" status: 200 len: 109 microversion: 2.1 time: 0.038404 Apr 14 10:59:45 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 252/762] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 10:59:45 2023] GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94/ips => generated 109 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:47 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-a3753456-e58f-433a-a781-2f9b8f7e245f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:47 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-a3753456-e58f-433a-a781-2f9b8f7e245f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a3753456-e58f-433a-a781-2f9b8f7e245f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a3753456-e58f-433a-a781-2f9b8f7e245f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a3753456-e58f-433a-a781-2f9b8f7e245f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a3753456-e58f-433a-a781-2f9b8f7e245f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a3753456-e58f-433a-a781-2f9b8f7e245f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a3753456-e58f-433a-a781-2f9b8f7e245f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:47 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-a3753456-e58f-433a-a781-2f9b8f7e245f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] HTTP exception thrown: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. Apr 14 10:59:47 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-a3753456-e58f-433a-a781-2f9b8f7e245f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Request method failure captured: Apr 14 10:59:47 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 HTTP/1.1 Apr 14 10:59:47 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:59:47 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:59:47 user devstack@n-api.service[61839]: Connection: close Apr 14 10:59:47 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:59:47 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:59:47 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:59:47 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:59:47 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS7hNCBfzIvhfOFH7PGsHkDHd5leYC7vYRencH8Ny9KJDQcJ4oIiZ-IsdyCvdSYgX4zYCps0SzSOP8E1YZ8hZc5C-J8r57KAIvTvftJ_0xXPwlAQV-PKAzMRBEJdwMhlelfgdgjvDxhYQPYds9TZ3LydDyOSNTF_LJro6yL-4KTxvMQ Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Project-Id: f8a9941095d445f48d70df26d8c90e6c Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8a9941095d445f48d70df26d8c90e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f8a9941095d445f48d70df26d8c90e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8a9941095d445f48d70df26d8c90e6c"}]}] Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Tenant-Id: f8a9941095d445f48d70df26d8c90e6c Apr 14 10:59:47 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:59:47 user devstack@n-api.service[61839]: X-User: tempest-AttachVolumeShelveTestJSON-1250068675-project-member Apr 14 10:59:47 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:59:47 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:59:47 user devstack@n-api.service[61839]: X-User-Id: 5afd3930d3a14aff8124a4782ec79870 Apr 14 10:59:47 user devstack@n-api.service[61839]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1250068675-project-member Apr 14 10:59:47 user devstack@n-api.service[61839]: method: > Apr 14 10:59:47 user devstack@n-api.service[61839]: exception: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. Apr 14 10:59:47 user devstack@n-api.service[61839]: action_args: {'id': 'fe152ebd-4f99-4fa8-bfdb-8744cdf3f387'} Apr 14 10:59:47 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. Apr 14 10:59:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:59:47 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-a3753456-e58f-433a-a781-2f9b8f7e245f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Returning 404 to user: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:59:47 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-a3753456-e58f-433a-a781-2f9b8f7e245f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" status: 404 len: 111 microversion: 2.20 time: 0.032936 Apr 14 10:59:47 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 254/763] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:59:47 2023] GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:59:47 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-6dea41ca-1657-417e-ae54-a7d3114c783d tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '.version_select at 0x7fcd1cf5a200>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:47 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-6dea41ca-1657-417e-ae54-a7d3114c783d tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083532637" status: 204 len: 0 microversion: 2.20 time: 0.036486 Apr 14 10:59:47 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 258/764] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 10:59:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083532637 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 10:59:48 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a762c7f3-c92d-42e9-8c00-610d87eb4fcb"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:48 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:48 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:48 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:48 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:48 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:48 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:48 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:48 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285265 Apr 14 10:59:48 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 253/765] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:59:48 2023] POST /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-b7674a02-87f2-4534-979b-5c36eed5ebdd tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-b7674a02-87f2-4534-979b-5c36eed5ebdd tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b7674a02-87f2-4534-979b-5c36eed5ebdd tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b7674a02-87f2-4534-979b-5c36eed5ebdd tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b7674a02-87f2-4534-979b-5c36eed5ebdd tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b7674a02-87f2-4534-979b-5c36eed5ebdd tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b7674a02-87f2-4534-979b-5c36eed5ebdd tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b7674a02-87f2-4534-979b-5c36eed5ebdd tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:51 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-b7674a02-87f2-4534-979b-5c36eed5ebdd tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063946 Apr 14 10:59:51 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 255/766] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:59:51 2023] GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:51 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-93a1a4b1-bd6d-4b83-9131-a4a55ff5c1de tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:51 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-93a1a4b1-bd6d-4b83-9131-a4a55ff5c1de tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-93a1a4b1-bd6d-4b83-9131-a4a55ff5c1de tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-93a1a4b1-bd6d-4b83-9131-a4a55ff5c1de tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-93a1a4b1-bd6d-4b83-9131-a4a55ff5c1de tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-93a1a4b1-bd6d-4b83-9131-a4a55ff5c1de tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-93a1a4b1-bd6d-4b83-9131-a4a55ff5c1de tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-93a1a4b1-bd6d-4b83-9131-a4a55ff5c1de tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:51 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-93a1a4b1-bd6d-4b83-9131-a4a55ff5c1de tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments/7979d4e6-ecf8-4e89-897f-13d8a1a7afdd" status: 200 len: 194 microversion: 2.1 time: 0.067926 Apr 14 10:59:51 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 259/767] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 10:59:51 2023] GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments/7979d4e6-ecf8-4e89-897f-13d8a1a7afdd => generated 194 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:51 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-99f263a0-6299-4420-b283-9f85080e9554 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:51 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-99f263a0-6299-4420-b283-9f85080e9554 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-99f263a0-6299-4420-b283-9f85080e9554 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-99f263a0-6299-4420-b283-9f85080e9554 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-99f263a0-6299-4420-b283-9f85080e9554 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-99f263a0-6299-4420-b283-9f85080e9554 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-99f263a0-6299-4420-b283-9f85080e9554 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:51 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-99f263a0-6299-4420-b283-9f85080e9554 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:51 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-99f263a0-6299-4420-b283-9f85080e9554 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] HTTP exception thrown: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. Apr 14 10:59:51 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-99f263a0-6299-4420-b283-9f85080e9554 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Request method failure captured: Apr 14 10:59:51 user devstack@n-api.service[61840]: request: DELETE /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 HTTP/1.1 Apr 14 10:59:51 user devstack@n-api.service[61840]: Accept: application/json Apr 14 10:59:51 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 10:59:51 user devstack@n-api.service[61840]: Connection: close Apr 14 10:59:51 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 10:59:51 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 10:59:51 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 10:59:51 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 10:59:51 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS7hNCBfzIvhfOFH7PGsHkDHd5leYC7vYRencH8Ny9KJDQcJ4oIiZ-IsdyCvdSYgX4zYCps0SzSOP8E1YZ8hZc5C-J8r57KAIvTvftJ_0xXPwlAQV-PKAzMRBEJdwMhlelfgdgjvDxhYQPYds9TZ3LydDyOSNTF_LJro6yL-4KTxvMQ Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Project-Id: f8a9941095d445f48d70df26d8c90e6c Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8a9941095d445f48d70df26d8c90e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f8a9941095d445f48d70df26d8c90e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8a9941095d445f48d70df26d8c90e6c"}]}] Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Tenant-Id: f8a9941095d445f48d70df26d8c90e6c Apr 14 10:59:51 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:59:51 user devstack@n-api.service[61840]: X-User: tempest-AttachVolumeShelveTestJSON-1250068675-project-member Apr 14 10:59:51 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 10:59:51 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 10:59:51 user devstack@n-api.service[61840]: X-User-Id: 5afd3930d3a14aff8124a4782ec79870 Apr 14 10:59:51 user devstack@n-api.service[61840]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1250068675-project-member Apr 14 10:59:51 user devstack@n-api.service[61840]: method: > Apr 14 10:59:51 user devstack@n-api.service[61840]: exception: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. Apr 14 10:59:51 user devstack@n-api.service[61840]: action_args: {'id': 'fe152ebd-4f99-4fa8-bfdb-8744cdf3f387'} Apr 14 10:59:51 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. Apr 14 10:59:51 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:59:51 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-99f263a0-6299-4420-b283-9f85080e9554 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Returning 404 to user: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:59:51 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-99f263a0-6299-4420-b283-9f85080e9554 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" status: 404 len: 111 microversion: 2.20 time: 0.039747 Apr 14 10:59:51 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 254/768] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 10:59:51 2023] DELETE /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-c1e0f88d-695d-4926-8e3b-64aeec4a598b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-c1e0f88d-695d-4926-8e3b-64aeec4a598b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c1e0f88d-695d-4926-8e3b-64aeec4a598b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c1e0f88d-695d-4926-8e3b-64aeec4a598b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c1e0f88d-695d-4926-8e3b-64aeec4a598b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c1e0f88d-695d-4926-8e3b-64aeec4a598b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c1e0f88d-695d-4926-8e3b-64aeec4a598b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c1e0f88d-695d-4926-8e3b-64aeec4a598b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:51 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-c1e0f88d-695d-4926-8e3b-64aeec4a598b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] HTTP exception thrown: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-c1e0f88d-695d-4926-8e3b-64aeec4a598b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Request method failure captured: Apr 14 10:59:51 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 HTTP/1.1 Apr 14 10:59:51 user devstack@n-api.service[61839]: Accept: application/json Apr 14 10:59:51 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 10:59:51 user devstack@n-api.service[61839]: Connection: close Apr 14 10:59:51 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 10:59:51 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 10:59:51 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 10:59:51 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 10:59:51 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS7hNCBfzIvhfOFH7PGsHkDHd5leYC7vYRencH8Ny9KJDQcJ4oIiZ-IsdyCvdSYgX4zYCps0SzSOP8E1YZ8hZc5C-J8r57KAIvTvftJ_0xXPwlAQV-PKAzMRBEJdwMhlelfgdgjvDxhYQPYds9TZ3LydDyOSNTF_LJro6yL-4KTxvMQ Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Project-Id: f8a9941095d445f48d70df26d8c90e6c Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8a9941095d445f48d70df26d8c90e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f8a9941095d445f48d70df26d8c90e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8a9941095d445f48d70df26d8c90e6c"}]}] Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Tenant-Id: f8a9941095d445f48d70df26d8c90e6c Apr 14 10:59:51 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:59:51 user devstack@n-api.service[61839]: X-User: tempest-AttachVolumeShelveTestJSON-1250068675-project-member Apr 14 10:59:51 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 10:59:51 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 10:59:51 user devstack@n-api.service[61839]: X-User-Id: 5afd3930d3a14aff8124a4782ec79870 Apr 14 10:59:51 user devstack@n-api.service[61839]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1250068675-project-member Apr 14 10:59:51 user devstack@n-api.service[61839]: method: > Apr 14 10:59:51 user devstack@n-api.service[61839]: exception: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. Apr 14 10:59:51 user devstack@n-api.service[61839]: action_args: {'id': 'fe152ebd-4f99-4fa8-bfdb-8744cdf3f387'} Apr 14 10:59:51 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. Apr 14 10:59:51 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 10:59:51 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-c1e0f88d-695d-4926-8e3b-64aeec4a598b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Returning 404 to user: Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:59:51 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-c1e0f88d-695d-4926-8e3b-64aeec4a598b tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" status: 404 len: 111 microversion: 2.20 time: 0.043077 Apr 14 10:59:51 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 256/769] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:59:51 2023] GET /compute/v2.1/servers/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:59:54 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:54 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:54 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:54 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:54 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:54 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:54 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:54 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:54 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.738835 Apr 14 10:59:54 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 260/770] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:59:54 2023] POST /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments => generated 194 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d23f5f24-4d22-459d-83b9-956d006be8bb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a762c7f3-c92d-42e9-8c00-610d87eb4fcb"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-d23f5f24-4d22-459d-83b9-956d006be8bb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d23f5f24-4d22-459d-83b9-956d006be8bb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d23f5f24-4d22-459d-83b9-956d006be8bb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d23f5f24-4d22-459d-83b9-956d006be8bb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d23f5f24-4d22-459d-83b9-956d006be8bb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d23f5f24-4d22-459d-83b9-956d006be8bb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d23f5f24-4d22-459d-83b9-956d006be8bb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:56 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-d23f5f24-4d22-459d-83b9-956d006be8bb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HTTP exception thrown: Invalid volume: volume a762c7f3-c92d-42e9-8c00-610d87eb4fcb is already attached to instances: ef413492-c781-459e-b99c-46a530034c94 Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d23f5f24-4d22-459d-83b9-956d006be8bb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Request method failure captured: Apr 14 10:59:56 user devstack@n-api.service[61840]: request: POST /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94/os-volume_attachments HTTP/1.1 Apr 14 10:59:56 user devstack@n-api.service[61840]: Accept: application/json Apr 14 10:59:56 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 10:59:56 user devstack@n-api.service[61840]: Connection: close Apr 14 10:59:56 user devstack@n-api.service[61840]: Content-Length: 74 Apr 14 10:59:56 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 10:59:56 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 10:59:56 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 10:59:56 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTAm6v8qUESI0IjizmIjmsJWXGLOjjeSrv09ri2T6RAbvAYajYyIrxw22PgYPfP-sFhLjBYVsJQMKmp7KoYSOSHZjTqklYHtEK1WW90dx3jL-AC6Ab0TV_VkQ0gzFfhCxphVnwf0RVdI8bvNKr-C_80J359JrotPIMB_M0XXXvYIzcQ Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Project-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Project-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}] Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Tenant: tempest-AttachVolumeNegativeTest-531644967 Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Tenant-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 10:59:56 user devstack@n-api.service[61840]: X-User: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 10:59:56 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 10:59:56 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 10:59:56 user devstack@n-api.service[61840]: X-User-Id: 78adbbdcd10e446daddde754e46309b2 Apr 14 10:59:56 user devstack@n-api.service[61840]: X-User-Name: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 10:59:56 user devstack@n-api.service[61840]: Apr 14 10:59:56 user devstack@n-api.service[61840]: {"volumeAttachment": {"volumeId": "a762c7f3-c92d-42e9-8c00-610d87eb4fcb"}} Apr 14 10:59:56 user devstack@n-api.service[61840]: method: > Apr 14 10:59:56 user devstack@n-api.service[61840]: exception: Invalid volume: volume a762c7f3-c92d-42e9-8c00-610d87eb4fcb is already attached to instances: ef413492-c781-459e-b99c-46a530034c94 Apr 14 10:59:56 user devstack@n-api.service[61840]: action_args: {'server_id': 'ef413492-c781-459e-b99c-46a530034c94', 'body': {'volumeAttachment': {'volumeId': 'a762c7f3-c92d-42e9-8c00-610d87eb4fcb'}}} Apr 14 10:59:56 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a762c7f3-c92d-42e9-8c00-610d87eb4fcb is already attached to instances: ef413492-c781-459e-b99c-46a530034c94 Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a762c7f3-c92d-42e9-8c00-610d87eb4fcb is already attached to instances: ef413492-c781-459e-b99c-46a530034c94 Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a762c7f3-c92d-42e9-8c00-610d87eb4fcb is already attached to instances: ef413492-c781-459e-b99c-46a530034c94 Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d23f5f24-4d22-459d-83b9-956d006be8bb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Returning 400 to user: Invalid volume: volume a762c7f3-c92d-42e9-8c00-610d87eb4fcb is already attached to instances: ef413492-c781-459e-b99c-46a530034c94 {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:59:56 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d23f5f24-4d22-459d-83b9-956d006be8bb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111576 Apr 14 10:59:56 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 255/771] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 10:59:56 2023] POST /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:59:56 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:56 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:56 user devstack@n-api.service[61839]: DEBUG nova.objects.instance [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'services' on Instance uuid ef413492-c781-459e-b99c-46a530034c94 {{(pid=61839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-ef8c8f51-d283-4b3e-8bf1-b111e6f66542 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-ef8c8f51-d283-4b3e-8bf1-b111e6f66542 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ef8c8f51-d283-4b3e-8bf1-b111e6f66542 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ef8c8f51-d283-4b3e-8bf1-b111e6f66542 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ef8c8f51-d283-4b3e-8bf1-b111e6f66542 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ef8c8f51-d283-4b3e-8bf1-b111e6f66542 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ef8c8f51-d283-4b3e-8bf1-b111e6f66542 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ef8c8f51-d283-4b3e-8bf1-b111e6f66542 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:56 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-ef8c8f51-d283-4b3e-8bf1-b111e6f66542 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] HTTP exception thrown: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-ef8c8f51-d283-4b3e-8bf1-b111e6f66542 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Request method failure captured: Apr 14 10:59:56 user devstack@n-api.service[61841]: request: DELETE /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae HTTP/1.1 Apr 14 10:59:56 user devstack@n-api.service[61841]: Accept: application/json Apr 14 10:59:56 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 10:59:56 user devstack@n-api.service[61841]: Connection: close Apr 14 10:59:56 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 10:59:56 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 10:59:56 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 10:59:56 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 10:59:56 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS7hNCBfzIvhfOFH7PGsHkDHd5leYC7vYRencH8Ny9KJDQcJ4oIiZ-IsdyCvdSYgX4zYCps0SzSOP8E1YZ8hZc5C-J8r57KAIvTvftJ_0xXPwlAQV-PKAzMRBEJdwMhlelfgdgjvDxhYQPYds9TZ3LydDyOSNTF_LJro6yL-4KTxvMQ Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Project-Id: f8a9941095d445f48d70df26d8c90e6c Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8a9941095d445f48d70df26d8c90e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f8a9941095d445f48d70df26d8c90e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8a9941095d445f48d70df26d8c90e6c"}]}] Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Tenant-Id: f8a9941095d445f48d70df26d8c90e6c Apr 14 10:59:56 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:59:56 user devstack@n-api.service[61841]: X-User: tempest-AttachVolumeShelveTestJSON-1250068675-project-member Apr 14 10:59:56 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 10:59:56 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 10:59:56 user devstack@n-api.service[61841]: X-User-Id: 5afd3930d3a14aff8124a4782ec79870 Apr 14 10:59:56 user devstack@n-api.service[61841]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1250068675-project-member Apr 14 10:59:56 user devstack@n-api.service[61841]: method: > Apr 14 10:59:56 user devstack@n-api.service[61841]: exception: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. Apr 14 10:59:56 user devstack@n-api.service[61841]: action_args: {'id': '4b767f1b-e97e-497c-8c70-8806203c76ae'} Apr 14 10:59:56 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. Apr 14 10:59:56 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-ef8c8f51-d283-4b3e-8bf1-b111e6f66542 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Returning 404 to user: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:59:56 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-ef8c8f51-d283-4b3e-8bf1-b111e6f66542 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae" status: 404 len: 111 microversion: 2.20 time: 0.042443 Apr 14 10:59:56 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 261/772] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 10:59:56 2023] DELETE /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-f7a98f0c-1bd5-4c44-b48c-c0358e1c4a97 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-f7a98f0c-1bd5-4c44-b48c-c0358e1c4a97 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f7a98f0c-1bd5-4c44-b48c-c0358e1c4a97 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f7a98f0c-1bd5-4c44-b48c-c0358e1c4a97 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f7a98f0c-1bd5-4c44-b48c-c0358e1c4a97 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f7a98f0c-1bd5-4c44-b48c-c0358e1c4a97 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f7a98f0c-1bd5-4c44-b48c-c0358e1c4a97 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f7a98f0c-1bd5-4c44-b48c-c0358e1c4a97 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:56 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-f7a98f0c-1bd5-4c44-b48c-c0358e1c4a97 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] HTTP exception thrown: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. Apr 14 10:59:56 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94/os-volume_attachments/a762c7f3-c92d-42e9-8c00-610d87eb4fcb" status: 202 len: 0 microversion: 2.1 time: 0.223902 Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-f7a98f0c-1bd5-4c44-b48c-c0358e1c4a97 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Request method failure captured: Apr 14 10:59:56 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae HTTP/1.1 Apr 14 10:59:56 user devstack@n-api.service[61840]: Accept: application/json Apr 14 10:59:56 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 10:59:56 user devstack@n-api.service[61840]: Connection: close Apr 14 10:59:56 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 10:59:56 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 10:59:56 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 10:59:56 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 10:59:56 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS7hNCBfzIvhfOFH7PGsHkDHd5leYC7vYRencH8Ny9KJDQcJ4oIiZ-IsdyCvdSYgX4zYCps0SzSOP8E1YZ8hZc5C-J8r57KAIvTvftJ_0xXPwlAQV-PKAzMRBEJdwMhlelfgdgjvDxhYQPYds9TZ3LydDyOSNTF_LJro6yL-4KTxvMQ Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Project-Id: f8a9941095d445f48d70df26d8c90e6c Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8a9941095d445f48d70df26d8c90e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f8a9941095d445f48d70df26d8c90e6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f8a9941095d445f48d70df26d8c90e6c"}]}] Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Tenant-Id: f8a9941095d445f48d70df26d8c90e6c Apr 14 10:59:56 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1250068675 Apr 14 10:59:56 user devstack@n-api.service[61840]: X-User: tempest-AttachVolumeShelveTestJSON-1250068675-project-member Apr 14 10:59:56 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 10:59:56 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 10:59:56 user devstack@n-api.service[61840]: X-User-Id: 5afd3930d3a14aff8124a4782ec79870 Apr 14 10:59:56 user devstack@n-api.service[61840]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1250068675-project-member Apr 14 10:59:56 user devstack@n-api.service[61840]: method: > Apr 14 10:59:56 user devstack@n-api.service[61840]: exception: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. Apr 14 10:59:56 user devstack@n-api.service[61840]: action_args: {'id': '4b767f1b-e97e-497c-8c70-8806203c76ae'} Apr 14 10:59:56 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. Apr 14 10:59:56 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 10:59:56 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 257/773] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 10:59:56 2023] DELETE /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94/os-volume_attachments/a762c7f3-c92d-42e9-8c00-610d87eb4fcb => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 10:59:56 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-f7a98f0c-1bd5-4c44-b48c-c0358e1c4a97 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Returning 404 to user: Instance 4b767f1b-e97e-497c-8c70-8806203c76ae could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 10:59:56 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-f7a98f0c-1bd5-4c44-b48c-c0358e1c4a97 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae" status: 404 len: 111 microversion: 2.20 time: 0.049525 Apr 14 10:59:56 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 256/774] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 10:59:56 2023] GET /compute/v2.1/servers/4b767f1b-e97e-497c-8c70-8806203c76ae => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-93e7cc5e-fb9f-4134-8ca7-8bf9d723533e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-93e7cc5e-fb9f-4134-8ca7-8bf9d723533e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-93e7cc5e-fb9f-4134-8ca7-8bf9d723533e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-93e7cc5e-fb9f-4134-8ca7-8bf9d723533e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-93e7cc5e-fb9f-4134-8ca7-8bf9d723533e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-93e7cc5e-fb9f-4134-8ca7-8bf9d723533e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-93e7cc5e-fb9f-4134-8ca7-8bf9d723533e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 10:59:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-93e7cc5e-fb9f-4134-8ca7-8bf9d723533e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 10:59:56 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-93e7cc5e-fb9f-4134-8ca7-8bf9d723533e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049061 Apr 14 10:59:56 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 262/775] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 10:59:56 2023] GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:00 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-70035827-24be-4706-93fd-a420b84db11c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:00 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-70035827-24be-4706-93fd-a420b84db11c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:00 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-70035827-24be-4706-93fd-a420b84db11c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:00 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-70035827-24be-4706-93fd-a420b84db11c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:00 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-70035827-24be-4706-93fd-a420b84db11c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:00 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-70035827-24be-4706-93fd-a420b84db11c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:00 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-70035827-24be-4706-93fd-a420b84db11c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:00 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-70035827-24be-4706-93fd-a420b84db11c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:00 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-70035827-24be-4706-93fd-a420b84db11c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:00:00 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-70035827-24be-4706-93fd-a420b84db11c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e" status: 200 len: 1428 microversion: 2.1 time: 0.210018 Apr 14 11:00:00 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 258/776] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:00:00 2023] GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e => generated 1428 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:00:04 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-adf129e3-ba10-400e-ba4f-3dd6d8e0b24d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:04 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-adf129e3-ba10-400e-ba4f-3dd6d8e0b24d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-adf129e3-ba10-400e-ba4f-3dd6d8e0b24d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-adf129e3-ba10-400e-ba4f-3dd6d8e0b24d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-adf129e3-ba10-400e-ba4f-3dd6d8e0b24d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-adf129e3-ba10-400e-ba4f-3dd6d8e0b24d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-adf129e3-ba10-400e-ba4f-3dd6d8e0b24d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-adf129e3-ba10-400e-ba4f-3dd6d8e0b24d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:04 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-adf129e3-ba10-400e-ba4f-3dd6d8e0b24d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052234 Apr 14 11:00:04 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 257/777] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:00:04 2023] GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:04 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-f0deca4b-4636-457f-a470-5763d7a72247 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:04 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-f0deca4b-4636-457f-a470-5763d7a72247 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f0deca4b-4636-457f-a470-5763d7a72247 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f0deca4b-4636-457f-a470-5763d7a72247 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f0deca4b-4636-457f-a470-5763d7a72247 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f0deca4b-4636-457f-a470-5763d7a72247 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f0deca4b-4636-457f-a470-5763d7a72247 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f0deca4b-4636-457f-a470-5763d7a72247 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:04 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-f0deca4b-4636-457f-a470-5763d7a72247 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments/7979d4e6-ecf8-4e89-897f-13d8a1a7afdd" status: 200 len: 194 microversion: 2.1 time: 0.043672 Apr 14 11:00:04 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 263/778] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 11:00:04 2023] GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments/7979d4e6-ecf8-4e89-897f-13d8a1a7afdd => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:04 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:04 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:04 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:04 user devstack@n-api.service[61839]: DEBUG nova.objects.instance [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'services' on Instance uuid 0bb99276-64ba-4641-8869-3f35eea2f76e {{(pid=61839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 11:00:04 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments/7979d4e6-ecf8-4e89-897f-13d8a1a7afdd" status: 202 len: 0 microversion: 2.1 time: 0.175611 Apr 14 11:00:04 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 259/779] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 11:00:04 2023] DELETE /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments/7979d4e6-ecf8-4e89-897f-13d8a1a7afdd => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:00:07 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-c649b1df-5172-4c85-9622-2a2ebbcc90eb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:07 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-c649b1df-5172-4c85-9622-2a2ebbcc90eb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:07 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c649b1df-5172-4c85-9622-2a2ebbcc90eb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:07 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c649b1df-5172-4c85-9622-2a2ebbcc90eb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:07 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c649b1df-5172-4c85-9622-2a2ebbcc90eb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:07 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c649b1df-5172-4c85-9622-2a2ebbcc90eb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:07 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c649b1df-5172-4c85-9622-2a2ebbcc90eb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:07 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c649b1df-5172-4c85-9622-2a2ebbcc90eb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:07 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-c649b1df-5172-4c85-9622-2a2ebbcc90eb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments/46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b" status: 200 len: 194 microversion: 2.1 time: 0.045075 Apr 14 11:00:07 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 258/780] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 11:00:07 2023] GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments/46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:07 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:07 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:07 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:00:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:07 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:07 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:00:07 user devstack@n-api.service[61841]: DEBUG nova.objects.instance [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'services' on Instance uuid 0bb99276-64ba-4641-8869-3f35eea2f76e {{(pid=61841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 11:00:07 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments/46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b" status: 202 len: 0 microversion: 2.1 time: 0.183557 Apr 14 11:00:07 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 264/781] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 11:00:07 2023] DELETE /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments/46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:00:10 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-36c5f0db-5da1-4837-847d-fc5b730f3fba tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:10 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-36c5f0db-5da1-4837-847d-fc5b730f3fba tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:10 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=23 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:00:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-36c5f0db-5da1-4837-847d-fc5b730f3fba tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-36c5f0db-5da1-4837-847d-fc5b730f3fba tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-36c5f0db-5da1-4837-847d-fc5b730f3fba tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-36c5f0db-5da1-4837-847d-fc5b730f3fba tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-36c5f0db-5da1-4837-847d-fc5b730f3fba tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:10 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-36c5f0db-5da1-4837-847d-fc5b730f3fba tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:10 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:00:10 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-36c5f0db-5da1-4837-847d-fc5b730f3fba tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052623 Apr 14 11:00:10 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 260/782] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:00:10 2023] GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 11:00:10 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d2a513ca-0990-4860-9b7a-b64875dcfe9e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:10 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-d2a513ca-0990-4860-9b7a-b64875dcfe9e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:10 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:00:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d2a513ca-0990-4860-9b7a-b64875dcfe9e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d2a513ca-0990-4860-9b7a-b64875dcfe9e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d2a513ca-0990-4860-9b7a-b64875dcfe9e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d2a513ca-0990-4860-9b7a-b64875dcfe9e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d2a513ca-0990-4860-9b7a-b64875dcfe9e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:10 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d2a513ca-0990-4860-9b7a-b64875dcfe9e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:10 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:00:11 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d2a513ca-0990-4860-9b7a-b64875dcfe9e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047226 Apr 14 11:00:11 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 259/783] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:00:10 2023] GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 11:00:11 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:11 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:11 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:00:11 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e" status: 204 len: 0 microversion: 2.1 time: 0.113846 Apr 14 11:00:11 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 265/784] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:00:11 2023] DELETE /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:00:11 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-b1dd7566-4c06-4b78-9d5e-55da586ba65c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:11 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-b1dd7566-4c06-4b78-9d5e-55da586ba65c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b1dd7566-4c06-4b78-9d5e-55da586ba65c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b1dd7566-4c06-4b78-9d5e-55da586ba65c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b1dd7566-4c06-4b78-9d5e-55da586ba65c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b1dd7566-4c06-4b78-9d5e-55da586ba65c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b1dd7566-4c06-4b78-9d5e-55da586ba65c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-b1dd7566-4c06-4b78-9d5e-55da586ba65c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:11 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-b1dd7566-4c06-4b78-9d5e-55da586ba65c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:00:11 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-b1dd7566-4c06-4b78-9d5e-55da586ba65c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e" status: 200 len: 1662 microversion: 2.1 time: 0.198808 Apr 14 11:00:11 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 261/785] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:00:11 2023] GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e => generated 1662 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:00:11 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-9cee3cda-22cc-4282-844e-4459be2e4603 req-42c6f6ed-926a-49cd-b7f0-406da9b8696a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb99276-64ba-4641-8869-3f35eea2f76e", "name": "network-vif-unplugged", "status": "completed", "tag": "7e4a1964-f2d0-4a4f-81fc-adf97c621209"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-9cee3cda-22cc-4282-844e-4459be2e4603 req-42c6f6ed-926a-49cd-b7f0-406da9b8696a service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-9cee3cda-22cc-4282-844e-4459be2e4603 req-42c6f6ed-926a-49cd-b7f0-406da9b8696a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:11 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-9cee3cda-22cc-4282-844e-4459be2e4603 req-42c6f6ed-926a-49cd-b7f0-406da9b8696a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:11 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-9cee3cda-22cc-4282-844e-4459be2e4603 req-42c6f6ed-926a-49cd-b7f0-406da9b8696a service nova] Creating event network-vif-unplugged:7e4a1964-f2d0-4a4f-81fc-adf97c621209 for instance 0bb99276-64ba-4641-8869-3f35eea2f76e on user Apr 14 11:00:11 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-9cee3cda-22cc-4282-844e-4459be2e4603 req-42c6f6ed-926a-49cd-b7f0-406da9b8696a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042578 Apr 14 11:00:11 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 260/786] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:00:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:13 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-ac95bdef-5898-40fa-a374-0eb5850c8196 req-2fdac674-e3ed-4601-b473-b4c7d2d09a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb99276-64ba-4641-8869-3f35eea2f76e", "name": "network-vif-plugged", "status": "completed", "tag": "7e4a1964-f2d0-4a4f-81fc-adf97c621209"}, {"server_uuid": "0bb99276-64ba-4641-8869-3f35eea2f76e", "name": "network-vif-deleted", "tag": "7e4a1964-f2d0-4a4f-81fc-adf97c621209"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ac95bdef-5898-40fa-a374-0eb5850c8196 req-2fdac674-e3ed-4601-b473-b4c7d2d09a47 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ac95bdef-5898-40fa-a374-0eb5850c8196 req-2fdac674-e3ed-4601-b473-b4c7d2d09a47 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ac95bdef-5898-40fa-a374-0eb5850c8196 req-2fdac674-e3ed-4601-b473-b4c7d2d09a47 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:13 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-ac95bdef-5898-40fa-a374-0eb5850c8196 req-2fdac674-e3ed-4601-b473-b4c7d2d09a47 service nova] Creating event network-vif-plugged:7e4a1964-f2d0-4a4f-81fc-adf97c621209 for instance 0bb99276-64ba-4641-8869-3f35eea2f76e on user Apr 14 11:00:13 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-ac95bdef-5898-40fa-a374-0eb5850c8196 req-2fdac674-e3ed-4601-b473-b4c7d2d09a47 service nova] Creating event network-vif-deleted:7e4a1964-f2d0-4a4f-81fc-adf97c621209 for instance 0bb99276-64ba-4641-8869-3f35eea2f76e on user Apr 14 11:00:13 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-ac95bdef-5898-40fa-a374-0eb5850c8196 req-2fdac674-e3ed-4601-b473-b4c7d2d09a47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035913 Apr 14 11:00:13 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 266/787] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:00:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:15 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-2d3d84a2-d294-4324-b2ca-b12d2d93fb3f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:15 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-2d3d84a2-d294-4324-b2ca-b12d2d93fb3f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2d3d84a2-d294-4324-b2ca-b12d2d93fb3f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2d3d84a2-d294-4324-b2ca-b12d2d93fb3f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2d3d84a2-d294-4324-b2ca-b12d2d93fb3f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2d3d84a2-d294-4324-b2ca-b12d2d93fb3f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2d3d84a2-d294-4324-b2ca-b12d2d93fb3f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2d3d84a2-d294-4324-b2ca-b12d2d93fb3f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:15 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-2d3d84a2-d294-4324-b2ca-b12d2d93fb3f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ad6531a67b4be58a195e1208157b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629ba0ab8074ed8bb4e59d545b74eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:00:15 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-2d3d84a2-d294-4324-b2ca-b12d2d93fb3f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656" status: 200 len: 1536 microversion: 2.1 time: 0.358329 Apr 14 11:00:15 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 262/788] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:00:14 2023] GET /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656 => generated 1536 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:00:16 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-8fb400b7-e072-4f75-ba0f-a10ade491606 req-a86e0463-13f1-4e9e-a6cb-26b1c1d2ffd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6a53c3-6e32-456c-a056-fbf1bef3b656", "tag": "c18cf2ba-f230-4684-a95c-14af689d7981"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8fb400b7-e072-4f75-ba0f-a10ade491606 req-a86e0463-13f1-4e9e-a6cb-26b1c1d2ffd1 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8fb400b7-e072-4f75-ba0f-a10ade491606 req-a86e0463-13f1-4e9e-a6cb-26b1c1d2ffd1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8fb400b7-e072-4f75-ba0f-a10ade491606 req-a86e0463-13f1-4e9e-a6cb-26b1c1d2ffd1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-8fb400b7-e072-4f75-ba0f-a10ade491606 req-a86e0463-13f1-4e9e-a6cb-26b1c1d2ffd1 service nova] Creating event network-changed:c18cf2ba-f230-4684-a95c-14af689d7981 for instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 on user Apr 14 11:00:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-8fb400b7-e072-4f75-ba0f-a10ade491606 req-a86e0463-13f1-4e9e-a6cb-26b1c1d2ffd1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037839 Apr 14 11:00:16 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 261/789] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:00:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:16 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0f6ad3f-7e59-4955-983c-a8497d388c95"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:16 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:17 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301501 Apr 14 11:00:17 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 267/790] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 11:00:16 2023] POST /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:24 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:24 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:25 user devstack@n-api.service[61839]: DEBUG nova.objects.instance [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lazy-loading 'services' on Instance uuid 3d6a53c3-6e32-456c-a056-fbf1bef3b656 {{(pid=61839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 11:00:25 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656/os-volume_attachments/d0f6ad3f-7e59-4955-983c-a8497d388c95" status: 202 len: 0 microversion: 2.1 time: 0.152494 Apr 14 11:00:25 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 263/791] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 11:00:24 2023] DELETE /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656/os-volume_attachments/d0f6ad3f-7e59-4955-983c-a8497d388c95 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:00:25 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-aa4570a5-f9b2-486b-8b34-6c7432c51dee tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:25 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-aa4570a5-f9b2-486b-8b34-6c7432c51dee tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aa4570a5-f9b2-486b-8b34-6c7432c51dee tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aa4570a5-f9b2-486b-8b34-6c7432c51dee tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aa4570a5-f9b2-486b-8b34-6c7432c51dee tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aa4570a5-f9b2-486b-8b34-6c7432c51dee tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aa4570a5-f9b2-486b-8b34-6c7432c51dee tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aa4570a5-f9b2-486b-8b34-6c7432c51dee tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:25 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-aa4570a5-f9b2-486b-8b34-6c7432c51dee tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054844 Apr 14 11:00:25 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 262/792] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:00:25 2023] GET /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:30 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-dce7baea-1aa9-4def-b5ea-6791d44927c6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:30 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-dce7baea-1aa9-4def-b5ea-6791d44927c6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:30 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:00:30 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:00:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-dce7baea-1aa9-4def-b5ea-6791d44927c6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-dce7baea-1aa9-4def-b5ea-6791d44927c6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-dce7baea-1aa9-4def-b5ea-6791d44927c6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-dce7baea-1aa9-4def-b5ea-6791d44927c6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-dce7baea-1aa9-4def-b5ea-6791d44927c6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-dce7baea-1aa9-4def-b5ea-6791d44927c6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:30 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-dce7baea-1aa9-4def-b5ea-6791d44927c6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] HTTP exception thrown: Instance 97f20661-8b60-439e-b7af-2fc2013c5ade could not be found. Apr 14 11:00:30 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-dce7baea-1aa9-4def-b5ea-6791d44927c6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Request method failure captured: Apr 14 11:00:30 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade HTTP/1.1 Apr 14 11:00:30 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:00:30 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:00:30 user devstack@n-api.service[61841]: Connection: close Apr 14 11:00:30 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:00:30 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:00:30 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:00:30 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:00:30 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:00:30 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4ehvfPZmc6Cn8y_nUIgKmNt1MynNk1Jx9BkLUufz1O66F8ryB_RqLkjS4mqbIJCUIPkzgHXdvu3Dcwu4qkkSxSHHlhjBDdWlDUtyfTJIWQwoe_fVC9Grh5B2CbrOSLWshhTkM317x0-K8crYQxMYn74sVjwEj0iqM8tWzpqn1eQII Apr 14 11:00:30 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:00:30 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:00:30 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:00:30 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:00:30 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:00:30 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:00:30 user devstack@n-api.service[61841]: X-Project-Id: bf93e5dac50342d0b65ef09711401e99 Apr 14 11:00:30 user devstack@n-api.service[61841]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-563868574 Apr 14 11:00:30 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:00:30 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:00:30 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf93e5dac50342d0b65ef09711401e99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf93e5dac50342d0b65ef09711401e99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf93e5dac50342d0b65ef09711401e99"}]}] Apr 14 11:00:30 user devstack@n-api.service[61841]: X-Tenant: tempest-ServerRescueNegativeTestJSON-563868574 Apr 14 11:00:30 user devstack@n-api.service[61841]: X-Tenant-Id: bf93e5dac50342d0b65ef09711401e99 Apr 14 11:00:30 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-563868574 Apr 14 11:00:30 user devstack@n-api.service[61841]: X-User: tempest-ServerRescueNegativeTestJSON-563868574-project-member Apr 14 11:00:30 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:00:30 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:00:30 user devstack@n-api.service[61841]: X-User-Id: e359578dcbb24755a216415053d415ef Apr 14 11:00:30 user devstack@n-api.service[61841]: X-User-Name: tempest-ServerRescueNegativeTestJSON-563868574-project-member Apr 14 11:00:30 user devstack@n-api.service[61841]: method: > Apr 14 11:00:30 user devstack@n-api.service[61841]: exception: Instance 97f20661-8b60-439e-b7af-2fc2013c5ade could not be found. Apr 14 11:00:30 user devstack@n-api.service[61841]: action_args: {'id': '97f20661-8b60-439e-b7af-2fc2013c5ade'} Apr 14 11:00:30 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97f20661-8b60-439e-b7af-2fc2013c5ade could not be found. Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97f20661-8b60-439e-b7af-2fc2013c5ade could not be found. Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97f20661-8b60-439e-b7af-2fc2013c5ade could not be found. Apr 14 11:00:30 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:00:30 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-dce7baea-1aa9-4def-b5ea-6791d44927c6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Returning 404 to user: Instance 97f20661-8b60-439e-b7af-2fc2013c5ade could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:00:30 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-dce7baea-1aa9-4def-b5ea-6791d44927c6 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade" status: 404 len: 111 microversion: 2.1 time: 0.036113 Apr 14 11:00:30 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 268/793] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:00:30 2023] GET /compute/v2.1/servers/97f20661-8b60-439e-b7af-2fc2013c5ade => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:00:37 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=7 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:00:37 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:00:37 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-05d421ea-b3ea-4c53-a85e-4451792c4af0 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Action: 'create', calling method: .version_select at 0x7fcd1ce53400>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1104967943"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:37 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-05d421ea-b3ea-4c53-a85e-4451792c4af0 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.488459 Apr 14 11:00:37 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 264/794] 10.0.0.210 () {64 vars in 1232 bytes} [Fri Apr 14 11:00:37 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 491 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 11:00:37 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-cbf97bc5-5550-476e-8f44-b5a089fe3e7f tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1cfb75b0>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:37 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=7 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:00:37 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=15 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:00:37 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-cbf97bc5-5550-476e-8f44-b5a089fe3e7f tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23" status: 200 len: 345 microversion: 2.1 time: 0.069170 Apr 14 11:00:37 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 263/795] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:37 2023] GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23 => generated 345 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:38 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-ffe5eb86-bbf7-45e4-84a6-891e0d02b657 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1d42aa70>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:38 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-ffe5eb86-bbf7-45e4-84a6-891e0d02b657 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23" status: 200 len: 345 microversion: 2.1 time: 0.054719 Apr 14 11:00:38 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 269/796] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:38 2023] GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:39 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8316b544-1481-45b6-b887-54622de88c17 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1ce51e10>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:39 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-8316b544-1481-45b6-b887-54622de88c17 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23" status: 200 len: 346 microversion: 2.1 time: 0.055511 Apr 14 11:00:39 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 265/797] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:39 2023] GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:39 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-c388a105-52c3-443f-a3e8-7cb2f0d0d491 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Action: 'create', calling method: .version_select at 0x7fcd1ce46170>, body: {"snapshot": {"volume_id": "0b92cee4-9bcc-4852-a2b7-1d09b2608c23", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2010686394"}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:39 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "3a042e69-a106-4e31-8c3c-f2c334a93b93"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:39 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:39 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:39 user devstack@n-api.service[61841]: DEBUG nova.objects.instance [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'flavor' on Instance uuid fbcca78c-fe73-4ef1-92f9-4c8061cad177 {{(pid=61841) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 11:00:40 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-da10827a-3303-47d2-b553-88e038b8823b tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-599152310", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "83520e94-8b02-44a3-87c9-e90f1018ddd6", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "0d829782-2ea4-4af3-8460-468b818423dc"}]}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-c388a105-52c3-443f-a3e8-7cb2f0d0d491 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.250609 Apr 14 11:00:40 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 264/798] 10.0.0.210 () {64 vars in 1239 bytes} [Fri Apr 14 11:00:39 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:40 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-da10827a-3303-47d2-b553-88e038b8823b tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] HTTP exception thrown: Block Device 83520e94-8b02-44a3-87c9-e90f1018ddd6 is not bootable. Apr 14 11:00:40 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-da10827a-3303-47d2-b553-88e038b8823b tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Request method failure captured: Apr 14 11:00:40 user devstack@n-api.service[61839]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 11:00:40 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:00:40 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:00:40 user devstack@n-api.service[61839]: Connection: close Apr 14 11:00:40 user devstack@n-api.service[61839]: Content-Length: 356 Apr 14 11:00:40 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:00:40 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:00:40 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:00:40 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:00:40 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTEIFQshLfVvHk6zzMGyR_oC5LUKpIB3AE99vu24J4VUKIZ_I-EwK7Y3I7wnUHCRWCubyFlBrfn9xQqhiAoc3tpsRHBshn37If4FOH70hV1TDB1AZ7SkDOxW_ds35MJgoa5aV2nhuLsDoazuYmrCamSynjx9Vk7fjpVlXk7fFD9b_oc Apr 14 11:00:40 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:00:40 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:00:40 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:00:40 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:00:40 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:00:40 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:00:40 user devstack@n-api.service[61839]: X-Project-Id: be1c0764b8a843808158644eb90704e6 Apr 14 11:00:40 user devstack@n-api.service[61839]: X-Project-Name: tempest-ServersNegativeTestJSON-1472676568 Apr 14 11:00:40 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:00:40 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:00:40 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be1c0764b8a843808158644eb90704e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be1c0764b8a843808158644eb90704e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be1c0764b8a843808158644eb90704e6"}]}] Apr 14 11:00:40 user devstack@n-api.service[61839]: X-Tenant: tempest-ServersNegativeTestJSON-1472676568 Apr 14 11:00:40 user devstack@n-api.service[61839]: X-Tenant-Id: be1c0764b8a843808158644eb90704e6 Apr 14 11:00:40 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1472676568 Apr 14 11:00:40 user devstack@n-api.service[61839]: X-User: tempest-ServersNegativeTestJSON-1472676568-project-member Apr 14 11:00:40 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:00:40 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:00:40 user devstack@n-api.service[61839]: X-User-Id: b3f2157c5d4d441db80ea4a3ca60e4dc Apr 14 11:00:40 user devstack@n-api.service[61839]: X-User-Name: tempest-ServersNegativeTestJSON-1472676568-project-member Apr 14 11:00:40 user devstack@n-api.service[61839]: Apr 14 11:00:40 user devstack@n-api.service[61839]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-599152310", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "83520e94-8b02-44a3-87c9-e90f1018ddd6", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "0d829782-2ea4-4af3-8460-468b818423dc"}]}} Apr 14 11:00:40 user devstack@n-api.service[61839]: method: > Apr 14 11:00:40 user devstack@n-api.service[61839]: exception: Block Device 83520e94-8b02-44a3-87c9-e90f1018ddd6 is not bootable. Apr 14 11:00:40 user devstack@n-api.service[61839]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-599152310', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '83520e94-8b02-44a3-87c9-e90f1018ddd6'}], 'networks': [{'uuid': '0d829782-2ea4-4af3-8460-468b818423dc'}]}}} Apr 14 11:00:40 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 83520e94-8b02-44a3-87c9-e90f1018ddd6 is not bootable. Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 83520e94-8b02-44a3-87c9-e90f1018ddd6 is not bootable. Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 83520e94-8b02-44a3-87c9-e90f1018ddd6 is not bootable. Apr 14 11:00:40 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:40 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-da10827a-3303-47d2-b553-88e038b8823b tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Returning 400 to user: Block Device 83520e94-8b02-44a3-87c9-e90f1018ddd6 is not bootable. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:00:40 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-da10827a-3303-47d2-b553-88e038b8823b tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.067516 Apr 14 11:00:40 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 266/799] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:00:40 2023] POST /compute/v2.1/servers => generated 110 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 11:00:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d4cf3743-4ad1-49a0-9e48-e4416e44bb2f tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1ce467a0>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:40 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-52e1b576-2ab2-4de6-b95c-b6cca1828cb2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:40 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-52e1b576-2ab2-4de6-b95c-b6cca1828cb2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-52e1b576-2ab2-4de6-b95c-b6cca1828cb2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-52e1b576-2ab2-4de6-b95c-b6cca1828cb2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-52e1b576-2ab2-4de6-b95c-b6cca1828cb2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-52e1b576-2ab2-4de6-b95c-b6cca1828cb2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-52e1b576-2ab2-4de6-b95c-b6cca1828cb2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-52e1b576-2ab2-4de6-b95c-b6cca1828cb2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d4cf3743-4ad1-49a0-9e48-e4416e44bb2f tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b" status: 200 len: 287 microversion: 2.1 time: 0.034883 Apr 14 11:00:40 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 265/800] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 11:00:40 2023] GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-cad812c2-a8ef-43b9-87d5-ef19243c83b3 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1ce444c0>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-cad812c2-a8ef-43b9-87d5-ef19243c83b3 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.063339 Apr 14 11:00:40 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 266/801] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 11:00:40 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-be723b55-e91b-4686-82fd-31d1342f67c1 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1cfb77f0>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-be723b55-e91b-4686-82fd-31d1342f67c1 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b" status: 200 len: 287 microversion: 2.1 time: 0.039219 Apr 14 11:00:40 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 267/802] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 11:00:40 2023] GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 11:00:40 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-52e1b576-2ab2-4de6-b95c-b6cca1828cb2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f2157c5d4d441db80ea4a3ca60e4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1c0764b8a843808158644eb90704e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:00:40 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-52e1b576-2ab2-4de6-b95c-b6cca1828cb2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96" status: 200 len: 1495 microversion: 2.1 time: 0.179758 Apr 14 11:00:40 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 267/803] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:00:40 2023] GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96 => generated 1495 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:00:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177/action" status: 200 len: 29 microversion: 2.87 time: 0.507679 Apr 14 11:00:40 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 270/804] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 11:00:39 2023] POST /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177/action => generated 29 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:00:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-f22dd3d2-5b5d-4b7b-8ef9-7842da21d852 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:40 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-f22dd3d2-5b5d-4b7b-8ef9-7842da21d852 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f22dd3d2-5b5d-4b7b-8ef9-7842da21d852 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f22dd3d2-5b5d-4b7b-8ef9-7842da21d852 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f22dd3d2-5b5d-4b7b-8ef9-7842da21d852 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f22dd3d2-5b5d-4b7b-8ef9-7842da21d852 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f22dd3d2-5b5d-4b7b-8ef9-7842da21d852 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f22dd3d2-5b5d-4b7b-8ef9-7842da21d852 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:40 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-f22dd3d2-5b5d-4b7b-8ef9-7842da21d852 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:00:40 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-f22dd3d2-5b5d-4b7b-8ef9-7842da21d852 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:00:40 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-f22dd3d2-5b5d-4b7b-8ef9-7842da21d852 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:00:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-f22dd3d2-5b5d-4b7b-8ef9-7842da21d852 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177" status: 200 len: 1776 microversion: 2.87 time: 0.184956 Apr 14 11:00:40 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 268/805] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:00:40 2023] GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177 => generated 1776 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:00:41 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-14d1ece8-5f6a-48be-8667-5b28b834ad00 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1d1a2710>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:41 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-14d1ece8-5f6a-48be-8667-5b28b834ad00 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b" status: 200 len: 287 microversion: 2.1 time: 0.036619 Apr 14 11:00:41 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 268/806] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 11:00:41 2023] GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:41 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-baab3a2b-ff91-4bb5-aea4-3030144deb86 req-8d6784b7-155d-44a9-bdbb-8317ed2c9ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcca78c-fe73-4ef1-92f9-4c8061cad177", "name": "network-vif-unplugged", "status": "completed", "tag": "845cc40f-1b03-4b85-8d19-fea731fe7f89"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-baab3a2b-ff91-4bb5-aea4-3030144deb86 req-8d6784b7-155d-44a9-bdbb-8317ed2c9ab9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-baab3a2b-ff91-4bb5-aea4-3030144deb86 req-8d6784b7-155d-44a9-bdbb-8317ed2c9ab9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-baab3a2b-ff91-4bb5-aea4-3030144deb86 req-8d6784b7-155d-44a9-bdbb-8317ed2c9ab9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:41 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-baab3a2b-ff91-4bb5-aea4-3030144deb86 req-8d6784b7-155d-44a9-bdbb-8317ed2c9ab9 service nova] Creating event network-vif-unplugged:845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 on user Apr 14 11:00:41 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-baab3a2b-ff91-4bb5-aea4-3030144deb86 req-8d6784b7-155d-44a9-bdbb-8317ed2c9ab9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039666 Apr 14 11:00:41 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 271/807] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:00:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:42 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-5d26297f-68a4-4d6a-8c0c-670e7bd0251e tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1cfb6b90>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:42 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-5d26297f-68a4-4d6a-8c0c-670e7bd0251e tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b" status: 200 len: 287 microversion: 2.1 time: 0.039030 Apr 14 11:00:42 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 269/808] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 11:00:42 2023] GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:43 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-23e20c4e-12be-4251-a505-4b2ea994d302 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1d10ef80>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:43 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-23e20c4e-12be-4251-a505-4b2ea994d302 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b" status: 200 len: 288 microversion: 2.1 time: 0.044850 Apr 14 11:00:43 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 269/809] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 11:00:43 2023] GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b => generated 288 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:43 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-d3ef6469-256b-4b30-ace3-aa622577b78b tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1ce5dc60>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:43 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-d3ef6469-256b-4b30-ace3-aa622577b78b tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b" status: 202 len: 0 microversion: 2.1 time: 0.133697 Apr 14 11:00:43 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 272/810] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 14 11:00:43 2023] DELETE /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:00:43 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-9451b719-718e-40fa-afb6-08a087a11932 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1ce93520>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:43 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-9451b719-718e-40fa-afb6-08a087a11932 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b" status: 200 len: 287 microversion: 2.1 time: 0.037048 Apr 14 11:00:43 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 270/811] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 11:00:43 2023] GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:44 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-2d1fc168-ae88-467e-94a7-417520ab1aad req-53416add-9c18-4594-bddc-7b2b10b6b922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcca78c-fe73-4ef1-92f9-4c8061cad177", "name": "network-vif-plugged", "status": "completed", "tag": "845cc40f-1b03-4b85-8d19-fea731fe7f89"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:44 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e7d0298b-a80a-44ab-a293-d696767c3f56 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1ce5eb90>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2d1fc168-ae88-467e-94a7-417520ab1aad req-53416add-9c18-4594-bddc-7b2b10b6b922 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2d1fc168-ae88-467e-94a7-417520ab1aad req-53416add-9c18-4594-bddc-7b2b10b6b922 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2d1fc168-ae88-467e-94a7-417520ab1aad req-53416add-9c18-4594-bddc-7b2b10b6b922 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:44 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-2d1fc168-ae88-467e-94a7-417520ab1aad req-53416add-9c18-4594-bddc-7b2b10b6b922 service nova] Creating event network-vif-plugged:845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 on user Apr 14 11:00:44 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-2d1fc168-ae88-467e-94a7-417520ab1aad req-53416add-9c18-4594-bddc-7b2b10b6b922 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042002 Apr 14 11:00:44 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 270/812] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:00:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:44 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-e7d0298b-a80a-44ab-a293-d696767c3f56 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b" status: 200 len: 287 microversion: 2.1 time: 0.041603 Apr 14 11:00:44 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 273/813] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 11:00:44 2023] GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 11:00:45 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-6ba5a0b5-9b5c-436c-8702-4cfafd4ed14e tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1ce477f0>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:45 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-6ba5a0b5-9b5c-436c-8702-4cfafd4ed14e tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b" status: 200 len: 287 microversion: 2.1 time: 0.034961 Apr 14 11:00:45 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 271/814] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 11:00:45 2023] GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-a060e29d-e6de-4319-b709-359be6f6fca3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-a060e29d-e6de-4319-b709-359be6f6fca3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a060e29d-e6de-4319-b709-359be6f6fca3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a060e29d-e6de-4319-b709-359be6f6fca3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a060e29d-e6de-4319-b709-359be6f6fca3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a060e29d-e6de-4319-b709-359be6f6fca3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a060e29d-e6de-4319-b709-359be6f6fca3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a060e29d-e6de-4319-b709-359be6f6fca3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:46 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcca78c-fe73-4ef1-92f9-4c8061cad177", "name": "network-vif-plugged", "status": "completed", "tag": "845cc40f-1b03-4b85-8d19-fea731fe7f89"}, {"server_uuid": "fbcca78c-fe73-4ef1-92f9-4c8061cad177", "name": "network-vif-plugged", "status": "completed", "tag": "845cc40f-1b03-4b85-8d19-fea731fe7f89"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-a060e29d-e6de-4319-b709-359be6f6fca3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047899 Apr 14 11:00:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:46 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 271/815] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:00:46 2023] GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 11:00:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:46 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] Creating event network-vif-plugged:845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 on user Apr 14 11:00:46 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] Creating event network-vif-plugged:845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 on user Apr 14 11:00:46 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-74e837c4-ded4-4b0a-bba3-d29b808f9aa8 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1cfb64d0>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:46 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062853 Apr 14 11:00:46 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 274/816] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:00:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:46 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-74e837c4-ded4-4b0a-bba3-d29b808f9aa8 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] HTTP exception thrown: Snapshot 49fe657c-f1ea-40e0-92e8-0b0cf376f02b could not be found. Apr 14 11:00:46 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-74e837c4-ded4-4b0a-bba3-d29b808f9aa8 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Request method failure captured: Apr 14 11:00:46 user devstack@n-api.service[61840]: request: GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b HTTP/1.1 Apr 14 11:00:46 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:00:46 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:00:46 user devstack@n-api.service[61840]: Connection: close Apr 14 11:00:46 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:00:46 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:00:46 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:00:46 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:00:46 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:00:46 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTJV55k8k_vff_MPC_Qa4IEiZd6ABbS7HWUDWGpM6KH0oFlNDE77sw_bMCzyabDw0V5l6H1UHhJeqjubJJiqUa9UcO33FDwvZ9HI8lg1wjLC5a-Cfr5j3pQHduFHzfb1D7ma2SHAnDGjKtKJjQffnGE3Cgb75JDTGWhzj3_zZpUlGWI Apr 14 11:00:46 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:00:46 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:00:46 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:00:46 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:00:46 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:00:46 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:00:46 user devstack@n-api.service[61840]: X-Project-Id: 0c073ced806443f9860979fd6c855aee Apr 14 11:00:46 user devstack@n-api.service[61840]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2031101207 Apr 14 11:00:46 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:00:46 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:00:46 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c073ced806443f9860979fd6c855aee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c073ced806443f9860979fd6c855aee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c073ced806443f9860979fd6c855aee"}]}] Apr 14 11:00:46 user devstack@n-api.service[61840]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2031101207 Apr 14 11:00:46 user devstack@n-api.service[61840]: X-Tenant-Id: 0c073ced806443f9860979fd6c855aee Apr 14 11:00:46 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2031101207 Apr 14 11:00:46 user devstack@n-api.service[61840]: X-User: tempest-VolumesSnapshotsTestJSON-2031101207-project-member Apr 14 11:00:46 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:00:46 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:00:46 user devstack@n-api.service[61840]: X-User-Id: 1075a906dc75467fa2f83855ce907a0f Apr 14 11:00:46 user devstack@n-api.service[61840]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2031101207-project-member Apr 14 11:00:46 user devstack@n-api.service[61840]: method: Apr 14 11:00:46 user devstack@n-api.service[61840]: exception: Snapshot 49fe657c-f1ea-40e0-92e8-0b0cf376f02b could not be found. Apr 14 11:00:46 user devstack@n-api.service[61840]: action_args: {'id': '49fe657c-f1ea-40e0-92e8-0b0cf376f02b'} Apr 14 11:00:46 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 49fe657c-f1ea-40e0-92e8-0b0cf376f02b could not be found. (HTTP 404) (Request-ID: req-9bcd0b43-647d-48ca-855a-5e7c67f028c7) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 49fe657c-f1ea-40e0-92e8-0b0cf376f02b could not be found. Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 49fe657c-f1ea-40e0-92e8-0b0cf376f02b could not be found. Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 49fe657c-f1ea-40e0-92e8-0b0cf376f02b could not be found. Apr 14 11:00:46 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:00:46 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-74e837c4-ded4-4b0a-bba3-d29b808f9aa8 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Returning 404 to user: Snapshot 49fe657c-f1ea-40e0-92e8-0b0cf376f02b could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:00:46 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-74e837c4-ded4-4b0a-bba3-d29b808f9aa8 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b" status: 404 len: 111 microversion: 2.1 time: 0.046309 Apr 14 11:00:46 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 272/817] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 11:00:46 2023] GET /compute/v2.1/os-snapshots/49fe657c-f1ea-40e0-92e8-0b0cf376f02b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-09967b46-df41-41e7-9512-283814979c20 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1ce52320>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:46 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:46 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:46 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:00:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-09967b46-df41-41e7-9512-283814979c20 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23" status: 202 len: 0 microversion: 2.1 time: 0.069020 Apr 14 11:00:46 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 272/818] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 11:00:46 2023] DELETE /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:00:46 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-e8b149bf-5aba-4e05-94f6-83c20c1b760f tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1ce444c0>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:46 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94" status: 204 len: 0 microversion: 2.1 time: 0.135154 Apr 14 11:00:46 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 275/819] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:00:46 2023] DELETE /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-02af9241-3fa3-46e5-b61c-bd077c219d51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-02af9241-3fa3-46e5-b61c-bd077c219d51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-02af9241-3fa3-46e5-b61c-bd077c219d51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-02af9241-3fa3-46e5-b61c-bd077c219d51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-02af9241-3fa3-46e5-b61c-bd077c219d51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-02af9241-3fa3-46e5-b61c-bd077c219d51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-02af9241-3fa3-46e5-b61c-bd077c219d51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-02af9241-3fa3-46e5-b61c-bd077c219d51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:46 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-e8b149bf-5aba-4e05-94f6-83c20c1b760f tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23" status: 200 len: 345 microversion: 2.1 time: 0.084754 Apr 14 11:00:46 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 273/820] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:46 2023] GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23 => generated 345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:47 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-eeeaf05e-2e5b-432f-986f-89db29153f56 req-14405e11-f89b-4057-a833-c3c84a67b4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef413492-c781-459e-b99c-46a530034c94", "name": "network-vif-unplugged", "status": "completed", "tag": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-eeeaf05e-2e5b-432f-986f-89db29153f56 req-14405e11-f89b-4057-a833-c3c84a67b4f2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-eeeaf05e-2e5b-432f-986f-89db29153f56 req-14405e11-f89b-4057-a833-c3c84a67b4f2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-eeeaf05e-2e5b-432f-986f-89db29153f56 req-14405e11-f89b-4057-a833-c3c84a67b4f2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:47 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-eeeaf05e-2e5b-432f-986f-89db29153f56 req-14405e11-f89b-4057-a833-c3c84a67b4f2 service nova] Creating event network-vif-unplugged:9e57c0d8-8572-4355-b3c0-d2b74196fc0d for instance ef413492-c781-459e-b99c-46a530034c94 on user Apr 14 11:00:47 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-eeeaf05e-2e5b-432f-986f-89db29153f56 req-14405e11-f89b-4057-a833-c3c84a67b4f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039117 Apr 14 11:00:47 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 276/821] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:00:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:47 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-02af9241-3fa3-46e5-b61c-bd077c219d51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:00:47 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-02af9241-3fa3-46e5-b61c-bd077c219d51 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94" status: 200 len: 1670 microversion: 2.1 time: 0.398298 Apr 14 11:00:47 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 273/822] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:00:46 2023] GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94 => generated 1670 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:00:47 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-13214b5f-5b08-4a67-b10c-d8f46c12bcde tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1ce93010>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:48 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-13214b5f-5b08-4a67-b10c-d8f46c12bcde tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23" status: 200 len: 345 microversion: 2.1 time: 0.055870 Apr 14 11:00:48 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 274/823] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:47 2023] GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 11:00:49 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-906f6dbc-fbb1-4b91-9ce7-c8227140705f tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1d03f910>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:49 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-906f6dbc-fbb1-4b91-9ce7-c8227140705f tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23" status: 200 len: 345 microversion: 2.1 time: 0.056639 Apr 14 11:00:49 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 277/824] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:49 2023] GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:49 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-a7bb99fb-0ad8-4e2e-9cb3-197d29b876aa req-d80fe824-2a0f-4c47-aaa5-76ed2c90512b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef413492-c781-459e-b99c-46a530034c94", "name": "network-vif-plugged", "status": "completed", "tag": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d"}, {"server_uuid": "ef413492-c781-459e-b99c-46a530034c94", "name": "network-vif-deleted", "tag": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-a7bb99fb-0ad8-4e2e-9cb3-197d29b876aa req-d80fe824-2a0f-4c47-aaa5-76ed2c90512b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-a7bb99fb-0ad8-4e2e-9cb3-197d29b876aa req-d80fe824-2a0f-4c47-aaa5-76ed2c90512b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-a7bb99fb-0ad8-4e2e-9cb3-197d29b876aa req-d80fe824-2a0f-4c47-aaa5-76ed2c90512b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:49 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-a7bb99fb-0ad8-4e2e-9cb3-197d29b876aa req-d80fe824-2a0f-4c47-aaa5-76ed2c90512b service nova] Creating event network-vif-plugged:9e57c0d8-8572-4355-b3c0-d2b74196fc0d for instance ef413492-c781-459e-b99c-46a530034c94 on user Apr 14 11:00:49 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-a7bb99fb-0ad8-4e2e-9cb3-197d29b876aa req-d80fe824-2a0f-4c47-aaa5-76ed2c90512b service nova] Creating event network-vif-deleted:9e57c0d8-8572-4355-b3c0-d2b74196fc0d for instance ef413492-c781-459e-b99c-46a530034c94 on user Apr 14 11:00:49 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-a7bb99fb-0ad8-4e2e-9cb3-197d29b876aa req-d80fe824-2a0f-4c47-aaa5-76ed2c90512b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031096 Apr 14 11:00:49 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 274/825] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:00:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:49 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-24e96684-52d3-409d-b8ce-609f58d63e70 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Action: 'create', calling method: .version_select at 0x7fcd1cfb7400>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1104464810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI56DgU3GFkyba07rJQ5gPWmf+s+oszKE0l2AEuBdasOhPKZbxdMzg3ltBRBJuQQhxmZUmQrEIrG8aYiF6ueY2ARcTYBp9F9Zb4rPcdzBhgtNF8DrTPiOHvxBGxF5+ocQ=="}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:49 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-24e96684-52d3-409d-b8ce-609f58d63e70 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Getting quotas for project 5809862340a84c83a772c65c77513608. Resources: {'key_pairs'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:00:49 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-24e96684-52d3-409d-b8ce-609f58d63e70 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Getting quotas for user 831215baa8fd4fe7ba65193bbbdad1b4 and project 5809862340a84c83a772c65c77513608. Resources: {'key_pairs'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:00:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-24e96684-52d3-409d-b8ce-609f58d63e70 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057197 Apr 14 11:00:49 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 275/826] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 11:00:49 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-145954405", "imageRef": "4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1104464810", "networks": [{"uuid": "d59680e7-ed50-4356-b665-ec64ff939708"}]}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG nova.network.neutron [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] validate_networks() for [('d59680e7-ed50-4356-b665-ec64ff939708', None, None, None, None, None)] {{(pid=61841) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:00:50 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-79c572c2-ab94-4e67-b2f9-1a046210a4a9 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1ce52320>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:50 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-79c572c2-ab94-4e67-b2f9-1a046210a4a9 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] HTTP exception thrown: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. Apr 14 11:00:50 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-79c572c2-ab94-4e67-b2f9-1a046210a4a9 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Request method failure captured: Apr 14 11:00:50 user devstack@n-api.service[61839]: request: GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23 HTTP/1.1 Apr 14 11:00:50 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:00:50 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:00:50 user devstack@n-api.service[61839]: Connection: close Apr 14 11:00:50 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:00:50 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:00:50 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:00:50 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:00:50 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTJV55k8k_vff_MPC_Qa4IEiZd6ABbS7HWUDWGpM6KH0oFlNDE77sw_bMCzyabDw0V5l6H1UHhJeqjubJJiqUa9UcO33FDwvZ9HI8lg1wjLC5a-Cfr5j3pQHduFHzfb1D7ma2SHAnDGjKtKJjQffnGE3Cgb75JDTGWhzj3_zZpUlGWI Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Project-Id: 0c073ced806443f9860979fd6c855aee Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2031101207 Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c073ced806443f9860979fd6c855aee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c073ced806443f9860979fd6c855aee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c073ced806443f9860979fd6c855aee"}]}] Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2031101207 Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Tenant-Id: 0c073ced806443f9860979fd6c855aee Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2031101207 Apr 14 11:00:50 user devstack@n-api.service[61839]: X-User: tempest-VolumesSnapshotsTestJSON-2031101207-project-member Apr 14 11:00:50 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:00:50 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:00:50 user devstack@n-api.service[61839]: X-User-Id: 1075a906dc75467fa2f83855ce907a0f Apr 14 11:00:50 user devstack@n-api.service[61839]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2031101207-project-member Apr 14 11:00:50 user devstack@n-api.service[61839]: method: Apr 14 11:00:50 user devstack@n-api.service[61839]: exception: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. Apr 14 11:00:50 user devstack@n-api.service[61839]: action_args: {'id': '0b92cee4-9bcc-4852-a2b7-1d09b2608c23'} Apr 14 11:00:50 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. (HTTP 404) (Request-ID: req-5e548fd2-8897-4b45-9622-cf0607692503) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-79c572c2-ab94-4e67-b2f9-1a046210a4a9 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Returning 404 to user: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:00:50 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-79c572c2-ab94-4e67-b2f9-1a046210a4a9 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23" status: 404 len: 109 microversion: 2.1 time: 0.074344 Apr 14 11:00:50 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 275/827] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:50 2023] GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:00:50 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-e3b51c28-a4c6-4b78-827e-8a51a2cf8d63 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1ce90b80>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-e3b51c28-a4c6-4b78-827e-8a51a2cf8d63 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] HTTP exception thrown: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. Apr 14 11:00:50 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-e3b51c28-a4c6-4b78-827e-8a51a2cf8d63 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Request method failure captured: Apr 14 11:00:50 user devstack@n-api.service[61840]: request: DELETE /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23 HTTP/1.1 Apr 14 11:00:50 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:00:50 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:00:50 user devstack@n-api.service[61840]: Connection: close Apr 14 11:00:50 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:00:50 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:00:50 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:00:50 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:00:50 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:00:50 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTJV55k8k_vff_MPC_Qa4IEiZd6ABbS7HWUDWGpM6KH0oFlNDE77sw_bMCzyabDw0V5l6H1UHhJeqjubJJiqUa9UcO33FDwvZ9HI8lg1wjLC5a-Cfr5j3pQHduFHzfb1D7ma2SHAnDGjKtKJjQffnGE3Cgb75JDTGWhzj3_zZpUlGWI Apr 14 11:00:50 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:00:50 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:00:50 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:00:50 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:00:50 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:00:50 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:00:50 user devstack@n-api.service[61840]: X-Project-Id: 0c073ced806443f9860979fd6c855aee Apr 14 11:00:50 user devstack@n-api.service[61840]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2031101207 Apr 14 11:00:50 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:00:50 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:00:50 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c073ced806443f9860979fd6c855aee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c073ced806443f9860979fd6c855aee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c073ced806443f9860979fd6c855aee"}]}] Apr 14 11:00:50 user devstack@n-api.service[61840]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2031101207 Apr 14 11:00:50 user devstack@n-api.service[61840]: X-Tenant-Id: 0c073ced806443f9860979fd6c855aee Apr 14 11:00:50 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2031101207 Apr 14 11:00:50 user devstack@n-api.service[61840]: X-User: tempest-VolumesSnapshotsTestJSON-2031101207-project-member Apr 14 11:00:50 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:00:50 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:00:50 user devstack@n-api.service[61840]: X-User-Id: 1075a906dc75467fa2f83855ce907a0f Apr 14 11:00:50 user devstack@n-api.service[61840]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2031101207-project-member Apr 14 11:00:50 user devstack@n-api.service[61840]: method: Apr 14 11:00:50 user devstack@n-api.service[61840]: exception: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. Apr 14 11:00:50 user devstack@n-api.service[61840]: action_args: {'id': '0b92cee4-9bcc-4852-a2b7-1d09b2608c23'} Apr 14 11:00:50 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. (HTTP 404) (Request-ID: req-2c1c67b2-9463-44c3-a1dc-da0cf045add5) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. Apr 14 11:00:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-e3b51c28-a4c6-4b78-827e-8a51a2cf8d63 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Returning 404 to user: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:00:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-e3b51c28-a4c6-4b78-827e-8a51a2cf8d63 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23" status: 404 len: 109 microversion: 2.1 time: 0.057185 Apr 14 11:00:50 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 276/828] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 11:00:50 2023] DELETE /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:00:50 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-eae9b1f5-457f-480f-89dc-6b0e56a0f2e3 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Calling method '.version_select at 0x7fcd1d1a3760>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:50 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-eae9b1f5-457f-480f-89dc-6b0e56a0f2e3 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] HTTP exception thrown: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. Apr 14 11:00:50 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-eae9b1f5-457f-480f-89dc-6b0e56a0f2e3 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Request method failure captured: Apr 14 11:00:50 user devstack@n-api.service[61839]: request: GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23 HTTP/1.1 Apr 14 11:00:50 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:00:50 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:00:50 user devstack@n-api.service[61839]: Connection: close Apr 14 11:00:50 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:00:50 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:00:50 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:00:50 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:00:50 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTJV55k8k_vff_MPC_Qa4IEiZd6ABbS7HWUDWGpM6KH0oFlNDE77sw_bMCzyabDw0V5l6H1UHhJeqjubJJiqUa9UcO33FDwvZ9HI8lg1wjLC5a-Cfr5j3pQHduFHzfb1D7ma2SHAnDGjKtKJjQffnGE3Cgb75JDTGWhzj3_zZpUlGWI Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Project-Id: 0c073ced806443f9860979fd6c855aee Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2031101207 Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c073ced806443f9860979fd6c855aee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c073ced806443f9860979fd6c855aee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c073ced806443f9860979fd6c855aee"}]}] Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2031101207 Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Tenant-Id: 0c073ced806443f9860979fd6c855aee Apr 14 11:00:50 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2031101207 Apr 14 11:00:50 user devstack@n-api.service[61839]: X-User: tempest-VolumesSnapshotsTestJSON-2031101207-project-member Apr 14 11:00:50 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:00:50 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:00:50 user devstack@n-api.service[61839]: X-User-Id: 1075a906dc75467fa2f83855ce907a0f Apr 14 11:00:50 user devstack@n-api.service[61839]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2031101207-project-member Apr 14 11:00:50 user devstack@n-api.service[61839]: method: Apr 14 11:00:50 user devstack@n-api.service[61839]: exception: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. Apr 14 11:00:50 user devstack@n-api.service[61839]: action_args: {'id': '0b92cee4-9bcc-4852-a2b7-1d09b2608c23'} Apr 14 11:00:50 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. (HTTP 404) (Request-ID: req-352693d3-d083-4a63-b1fd-966eaee7a448) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. Apr 14 11:00:50 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:50 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-eae9b1f5-457f-480f-89dc-6b0e56a0f2e3 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] Returning 404 to user: Volume 0b92cee4-9bcc-4852-a2b7-1d09b2608c23 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:00:50 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-eae9b1f5-457f-480f-89dc-6b0e56a0f2e3 tempest-VolumesSnapshotsTestJSON-2031101207 tempest-VolumesSnapshotsTestJSON-2031101207-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23" status: 404 len: 109 microversion: 2.1 time: 0.039944 Apr 14 11:00:50 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 276/829] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:50 2023] GET /compute/v2.1/os-volumes/0b92cee4-9bcc-4852-a2b7-1d09b2608c23 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Flavor limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Image limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Flavor pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Image pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Getting quotas for project 5809862340a84c83a772c65c77513608. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Getting quotas for user 831215baa8fd4fe7ba65193bbbdad1b4 and project 5809862340a84c83a772c65c77513608. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Going to run 1 instances... {{(pid=61841) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:00:50 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61841) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:00:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.620748 Apr 14 11:00:50 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 278/830] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:00:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:00:50 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:00:50 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-37849f9d-ee62-4d45-a198-f30c7c0068ee tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:50 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-37849f9d-ee62-4d45-a198-f30c7c0068ee tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:00:50 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-37849f9d-ee62-4d45-a198-f30c7c0068ee tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:00:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-37849f9d-ee62-4d45-a198-f30c7c0068ee tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" status: 200 len: 1252 microversion: 2.1 time: 0.145604 Apr 14 11:00:50 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 277/831] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:00:50 2023] GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => generated 1252 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:00:52 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-9923f3e7-1212-46ab-bf55-918bda1a0438 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d1a3d00>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-88385614", "metadata": {"Type": "work"}}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:52 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-9923f3e7-1212-46ab-bf55-918bda1a0438 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.697241 Apr 14 11:00:52 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 277/832] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 11:00:52 2023] POST /compute/v2.1/os-volumes => generated 351 bytes in 699 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 11:00:52 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-33430a48-8fff-443c-ba44-58e5425e0556 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] Calling method '.version_select at 0x7fcd1cfbacb0>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:52 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-33430a48-8fff-443c-ba44-58e5425e0556 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e" status: 200 len: 351 microversion: 2.1 time: 0.056062 Apr 14 11:00:52 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 279/833] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:52 2023] GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:53 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-f2b3be17-d7d5-49f7-84ce-9cffeaedc30f req-53419b29-8007-4a8f-b8b1-f2c7a61b4a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f2b3be17-d7d5-49f7-84ce-9cffeaedc30f req-53419b29-8007-4a8f-b8b1-f2c7a61b4a0c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f2b3be17-d7d5-49f7-84ce-9cffeaedc30f req-53419b29-8007-4a8f-b8b1-f2c7a61b4a0c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f2b3be17-d7d5-49f7-84ce-9cffeaedc30f req-53419b29-8007-4a8f-b8b1-f2c7a61b4a0c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-f2b3be17-d7d5-49f7-84ce-9cffeaedc30f req-53419b29-8007-4a8f-b8b1-f2c7a61b4a0c service nova] Creating event network-changed:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:00:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-f2b3be17-d7d5-49f7-84ce-9cffeaedc30f req-53419b29-8007-4a8f-b8b1-f2c7a61b4a0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035190 Apr 14 11:00:53 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 278/834] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:00:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:53 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-91765568-c0be-46f4-af52-9519fef62eb1 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] Calling method '.version_select at 0x7fcd1df2dd80>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:54 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-91765568-c0be-46f4-af52-9519fef62eb1 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e" status: 200 len: 351 microversion: 2.1 time: 0.109754 Apr 14 11:00:54 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 278/835] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:53 2023] GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e => generated 351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:55 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-6321152e-dff1-4389-9281-8fc49dff335c tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] Calling method '.version_select at 0x7fcd1ce5e9e0>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:55 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-6321152e-dff1-4389-9281-8fc49dff335c tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e" status: 200 len: 352 microversion: 2.1 time: 0.054988 Apr 14 11:00:55 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 280/836] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:55 2023] GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:55 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-5eff7f7c-eab8-4f17-949d-bd1920824ea9 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] Calling method '.version_select at 0x7fcd1ce929e0>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:55 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-5eff7f7c-eab8-4f17-949d-bd1920824ea9 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e" status: 200 len: 352 microversion: 2.1 time: 0.058336 Apr 14 11:00:55 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 279/837] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:55 2023] GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:55 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-b8683976-d83e-4bc5-80a9-0290f436d11f tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] Calling method '.version_select at 0x7fcd1d29b400>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:55 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-b8683976-d83e-4bc5-80a9-0290f436d11f tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e" status: 202 len: 0 microversion: 2.1 time: 0.063951 Apr 14 11:00:55 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 279/838] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 11:00:55 2023] DELETE /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:00:55 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-91d12387-fa7c-483f-af68-7d89ceaea6d4 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] Calling method '.version_select at 0x7fcd1d081c60>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:55 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-91d12387-fa7c-483f-af68-7d89ceaea6d4 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e" status: 200 len: 351 microversion: 2.1 time: 0.064125 Apr 14 11:00:55 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 281/839] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:55 2023] GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:55 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-8303a842-fbc7-4443-9dc3-c5a007c44011 req-1823ce65-7f1b-4751-9beb-903819215f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "name": "network-vif-plugged", "status": "completed", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8303a842-fbc7-4443-9dc3-c5a007c44011 req-1823ce65-7f1b-4751-9beb-903819215f93 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8303a842-fbc7-4443-9dc3-c5a007c44011 req-1823ce65-7f1b-4751-9beb-903819215f93 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:55 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-8303a842-fbc7-4443-9dc3-c5a007c44011 req-1823ce65-7f1b-4751-9beb-903819215f93 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:55 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-8303a842-fbc7-4443-9dc3-c5a007c44011 req-1823ce65-7f1b-4751-9beb-903819215f93 service nova] Creating event network-vif-plugged:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:00:55 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-8303a842-fbc7-4443-9dc3-c5a007c44011 req-1823ce65-7f1b-4751-9beb-903819215f93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046391 Apr 14 11:00:55 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 280/840] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:00:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:56 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-927ace89-b7d7-4c35-9881-48bd6e6d119f tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] Calling method '.version_select at 0x7fcd1ce508b0>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:56 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-927ace89-b7d7-4c35-9881-48bd6e6d119f tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e" status: 200 len: 351 microversion: 2.1 time: 0.054263 Apr 14 11:00:56 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 280/841] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:56 2023] GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:57 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-c8ecbe27-bf80-458e-8fb6-c949a37b6500 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] Calling method '.version_select at 0x7fcd1cfb9d80>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:57 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-c8ecbe27-bf80-458e-8fb6-c949a37b6500 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e" status: 200 len: 351 microversion: 2.1 time: 0.056486 Apr 14 11:00:57 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 282/842] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:57 2023] GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:57 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-9a58479d-3a01-4ede-8e33-f4b33b4b1731 req-f2d2706f-3487-445a-9d01-6b13c89036f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "name": "network-vif-plugged", "status": "completed", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:00:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-9a58479d-3a01-4ede-8e33-f4b33b4b1731 req-f2d2706f-3487-445a-9d01-6b13c89036f9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:00:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-9a58479d-3a01-4ede-8e33-f4b33b4b1731 req-f2d2706f-3487-445a-9d01-6b13c89036f9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:00:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-9a58479d-3a01-4ede-8e33-f4b33b4b1731 req-f2d2706f-3487-445a-9d01-6b13c89036f9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:00:57 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-9a58479d-3a01-4ede-8e33-f4b33b4b1731 req-f2d2706f-3487-445a-9d01-6b13c89036f9 service nova] Creating event network-vif-plugged:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:00:58 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-9a58479d-3a01-4ede-8e33-f4b33b4b1731 req-f2d2706f-3487-445a-9d01-6b13c89036f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118950 Apr 14 11:00:58 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 281/843] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:00:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:00:58 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-349f65c0-8dbc-44e5-979a-1307731710c1 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] Calling method '.version_select at 0x7fcd1d298040>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:00:58 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-349f65c0-8dbc-44e5-979a-1307731710c1 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] HTTP exception thrown: Volume 17b62398-ea11-4d4b-9747-79a7f2bff64e could not be found. Apr 14 11:00:58 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-349f65c0-8dbc-44e5-979a-1307731710c1 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] Request method failure captured: Apr 14 11:00:58 user devstack@n-api.service[61839]: request: GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e HTTP/1.1 Apr 14 11:00:58 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:00:58 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:00:58 user devstack@n-api.service[61839]: Connection: close Apr 14 11:00:58 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:00:58 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:00:58 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:00:58 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:00:58 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:00:58 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTJkWb7S1ilYPS8CJSx19fBnD_2wqnxJ1vtlfXYzXfBRNPPTx3Lm1lTixZ1BHl7r_ExOj28MWWleRuRIjEMB2Pofbx5MrQ_K7YYPeqcDrnKOSqGZV7xDEGwGMkR8izcdlFxKW3qsG_hYkMmeFe33viOWu2g9LxFpMxSz3Nx-rS0lszA Apr 14 11:00:58 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:00:58 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:00:58 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:00:58 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:00:58 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:00:58 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:00:58 user devstack@n-api.service[61839]: X-Project-Id: bbaaacf89a18405da81325bcf0c76e48 Apr 14 11:00:58 user devstack@n-api.service[61839]: X-Project-Name: tempest-VolumesGetTestJSON-1850834860 Apr 14 11:00:58 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:00:58 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:00:58 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bbaaacf89a18405da81325bcf0c76e48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bbaaacf89a18405da81325bcf0c76e48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bbaaacf89a18405da81325bcf0c76e48"}]}] Apr 14 11:00:58 user devstack@n-api.service[61839]: X-Tenant: tempest-VolumesGetTestJSON-1850834860 Apr 14 11:00:58 user devstack@n-api.service[61839]: X-Tenant-Id: bbaaacf89a18405da81325bcf0c76e48 Apr 14 11:00:58 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-VolumesGetTestJSON-1850834860 Apr 14 11:00:58 user devstack@n-api.service[61839]: X-User: tempest-VolumesGetTestJSON-1850834860-project-member Apr 14 11:00:58 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:00:58 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:00:58 user devstack@n-api.service[61839]: X-User-Id: 438eec23063140b09c4b7c6885e13edc Apr 14 11:00:58 user devstack@n-api.service[61839]: X-User-Name: tempest-VolumesGetTestJSON-1850834860-project-member Apr 14 11:00:58 user devstack@n-api.service[61839]: method: Apr 14 11:00:58 user devstack@n-api.service[61839]: exception: Volume 17b62398-ea11-4d4b-9747-79a7f2bff64e could not be found. Apr 14 11:00:58 user devstack@n-api.service[61839]: action_args: {'id': '17b62398-ea11-4d4b-9747-79a7f2bff64e'} Apr 14 11:00:58 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 17b62398-ea11-4d4b-9747-79a7f2bff64e could not be found. (HTTP 404) (Request-ID: req-b7d52fb6-cb18-4d23-8b74-152e22b63ae2) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 17b62398-ea11-4d4b-9747-79a7f2bff64e could not be found. Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 17b62398-ea11-4d4b-9747-79a7f2bff64e could not be found. Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 17b62398-ea11-4d4b-9747-79a7f2bff64e could not be found. Apr 14 11:00:58 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:00:58 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-349f65c0-8dbc-44e5-979a-1307731710c1 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] Returning 404 to user: Volume 17b62398-ea11-4d4b-9747-79a7f2bff64e could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:00:58 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-349f65c0-8dbc-44e5-979a-1307731710c1 tempest-VolumesGetTestJSON-1850834860 tempest-VolumesGetTestJSON-1850834860-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e" status: 404 len: 109 microversion: 2.1 time: 0.168661 Apr 14 11:00:58 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 281/844] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:00:58 2023] GET /compute/v2.1/os-volumes/17b62398-ea11-4d4b-9747-79a7f2bff64e => generated 109 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 11:01:01 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:01 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:01 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:01 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:01 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-2cc05bf1-d73f-43f1-ba7f-c3c879dbf3dc tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:01 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-2cc05bf1-d73f-43f1-ba7f-c3c879dbf3dc tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2cc05bf1-d73f-43f1-ba7f-c3c879dbf3dc tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2cc05bf1-d73f-43f1-ba7f-c3c879dbf3dc tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2cc05bf1-d73f-43f1-ba7f-c3c879dbf3dc tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2cc05bf1-d73f-43f1-ba7f-c3c879dbf3dc tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2cc05bf1-d73f-43f1-ba7f-c3c879dbf3dc tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2cc05bf1-d73f-43f1-ba7f-c3c879dbf3dc tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:01 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-2cc05bf1-d73f-43f1-ba7f-c3c879dbf3dc tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.110194 Apr 14 11:01:01 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 283/845] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 11:01:01 2023] GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e/os-interface => generated 282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:01 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:01 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-5974152d-9212-4ac0-9825-9e3b8e404728 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:01 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-5974152d-9212-4ac0-9825-9e3b8e404728 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:01 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5974152d-9212-4ac0-9825-9e3b8e404728 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:01 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5974152d-9212-4ac0-9825-9e3b8e404728 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:01 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5974152d-9212-4ac0-9825-9e3b8e404728 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:01 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5974152d-9212-4ac0-9825-9e3b8e404728 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:01 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5974152d-9212-4ac0-9825-9e3b8e404728 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:01 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5974152d-9212-4ac0-9825-9e3b8e404728 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:01 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-5974152d-9212-4ac0-9825-9e3b8e404728 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] HTTP exception thrown: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. Apr 14 11:01:01 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-5974152d-9212-4ac0-9825-9e3b8e404728 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Request method failure captured: Apr 14 11:01:01 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e HTTP/1.1 Apr 14 11:01:01 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:01:01 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:01:01 user devstack@n-api.service[61840]: Connection: close Apr 14 11:01:01 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:01:01 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:01:01 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:01:01 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:01:01 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:01:01 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS84vM36G7Nioj-ToQvoMdFXKF2xLhh7C9a3nbB4y18IkUJEogQn474a0MLG191bnwycwvsi0zS8LTGssOiGIEYNvHQjgijI-jHv2hvRRh1UXWy8xpVhO7o4yY1wPKzSfRxurp_fOMRnE8XRArHY8IVEqoNbCj4XRAQxEHh0XdXxD38 Apr 14 11:01:01 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:01:01 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:01:01 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:01:01 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:01:01 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:01:01 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:01:01 user devstack@n-api.service[61840]: X-Project-Id: eb9b9fc4f2e244879502006bb844761c Apr 14 11:01:01 user devstack@n-api.service[61840]: X-Project-Name: tempest-AttachVolumeTestJSON-821788322 Apr 14 11:01:01 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:01:01 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:01:01 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb9b9fc4f2e244879502006bb844761c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb9b9fc4f2e244879502006bb844761c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb9b9fc4f2e244879502006bb844761c"}]}] Apr 14 11:01:01 user devstack@n-api.service[61840]: X-Tenant: tempest-AttachVolumeTestJSON-821788322 Apr 14 11:01:01 user devstack@n-api.service[61840]: X-Tenant-Id: eb9b9fc4f2e244879502006bb844761c Apr 14 11:01:01 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821788322 Apr 14 11:01:01 user devstack@n-api.service[61840]: X-User: tempest-AttachVolumeTestJSON-821788322-project-member Apr 14 11:01:01 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:01:01 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:01:01 user devstack@n-api.service[61840]: X-User-Id: 11cb4a1e78d447dbb18cde5453fe499c Apr 14 11:01:01 user devstack@n-api.service[61840]: X-User-Name: tempest-AttachVolumeTestJSON-821788322-project-member Apr 14 11:01:01 user devstack@n-api.service[61840]: method: > Apr 14 11:01:01 user devstack@n-api.service[61840]: exception: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. Apr 14 11:01:01 user devstack@n-api.service[61840]: action_args: {'id': '0bb99276-64ba-4641-8869-3f35eea2f76e'} Apr 14 11:01:01 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. Apr 14 11:01:01 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:01 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-5974152d-9212-4ac0-9825-9e3b8e404728 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Returning 404 to user: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:01:01 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-5974152d-9212-4ac0-9825-9e3b8e404728 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e" status: 404 len: 111 microversion: 2.1 time: 0.043600 Apr 14 11:01:01 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 282/846] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:01:01 2023] GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:01:01 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=12 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:01 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=22 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:01 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-72699ae5-1681-4e98-bc9d-0ef84f896468 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '.version_select at 0x7fcd1d29b910>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:01 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-72699ae5-1681-4e98-bc9d-0ef84f896468 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1954654699" status: 202 len: 0 microversion: 2.1 time: 0.031598 Apr 14 11:01:01 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 282/847] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 11:01:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1954654699 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:01:02 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-d47e94f6-3223-4c72-b831-063381820f64 req-c5101947-3e50-4f1c-a984-d167bea3b60c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7", "tag": "ec941aab-7c95-415b-96bc-e74ebaeb9385"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-d47e94f6-3223-4c72-b831-063381820f64 req-c5101947-3e50-4f1c-a984-d167bea3b60c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-d47e94f6-3223-4c72-b831-063381820f64 req-c5101947-3e50-4f1c-a984-d167bea3b60c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-d47e94f6-3223-4c72-b831-063381820f64 req-c5101947-3e50-4f1c-a984-d167bea3b60c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:02 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-290f7ec1-4c98-405f-ab61-f1be04e2489c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:02 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-290f7ec1-4c98-405f-ab61-f1be04e2489c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-290f7ec1-4c98-405f-ab61-f1be04e2489c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-290f7ec1-4c98-405f-ab61-f1be04e2489c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-290f7ec1-4c98-405f-ab61-f1be04e2489c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-290f7ec1-4c98-405f-ab61-f1be04e2489c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:02 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-d47e94f6-3223-4c72-b831-063381820f64 req-c5101947-3e50-4f1c-a984-d167bea3b60c service nova] Creating event network-changed:ec941aab-7c95-415b-96bc-e74ebaeb9385 for instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 on user Apr 14 11:01:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-290f7ec1-4c98-405f-ab61-f1be04e2489c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-290f7ec1-4c98-405f-ab61-f1be04e2489c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:02 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-d47e94f6-3223-4c72-b831-063381820f64 req-c5101947-3e50-4f1c-a984-d167bea3b60c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057915 Apr 14 11:01:02 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 284/848] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:02 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-290f7ec1-4c98-405f-ab61-f1be04e2489c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:01:02 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-290f7ec1-4c98-405f-ab61-f1be04e2489c tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e" status: 200 len: 1428 microversion: 2.1 time: 0.220398 Apr 14 11:01:02 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 283/849] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:01:02 2023] GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e => generated 1428 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Old instance type m1.nano, new instance type m1.micro {{(pid=61839) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting quotas for project 3ea2cb4dfa5b4a52b658efd8f5aefb36. Resources: {'cores', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting quotas for user 5873a358bf544691b12cd2979f5e36dc and project 3ea2cb4dfa5b4a52b658efd8f5aefb36. Resources: {'cores', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:01:02 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:01:02 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e/action" status: 202 len: 0 microversion: 2.1 time: 0.174133 Apr 14 11:01:02 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 283/850] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 11:01:02 2023] POST /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:01:02 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-abdbb7e8-46cc-4deb-9196-0ff75172f501 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:02 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-abdbb7e8-46cc-4deb-9196-0ff75172f501 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-abdbb7e8-46cc-4deb-9196-0ff75172f501 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-abdbb7e8-46cc-4deb-9196-0ff75172f501 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-abdbb7e8-46cc-4deb-9196-0ff75172f501 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-abdbb7e8-46cc-4deb-9196-0ff75172f501 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-abdbb7e8-46cc-4deb-9196-0ff75172f501 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-abdbb7e8-46cc-4deb-9196-0ff75172f501 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:02 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-abdbb7e8-46cc-4deb-9196-0ff75172f501 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:01:02 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-abdbb7e8-46cc-4deb-9196-0ff75172f501 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e" status: 200 len: 1437 microversion: 2.1 time: 0.214766 Apr 14 11:01:02 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 285/851] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:01:02 2023] GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e => generated 1437 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:01:04 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-a47a0597-fc65-442b-a754-a86573205079 req-83e71df9-cf59-4fd8-8bf7-fff2982472de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db2e71c-939b-4d2f-b1be-c2122f7cd73e", "tag": "1e547ec7-7efd-480f-84be-806c8cf25b90"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-a47a0597-fc65-442b-a754-a86573205079 req-83e71df9-cf59-4fd8-8bf7-fff2982472de service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-a47a0597-fc65-442b-a754-a86573205079 req-83e71df9-cf59-4fd8-8bf7-fff2982472de service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-a47a0597-fc65-442b-a754-a86573205079 req-83e71df9-cf59-4fd8-8bf7-fff2982472de service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:04 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-a47a0597-fc65-442b-a754-a86573205079 req-83e71df9-cf59-4fd8-8bf7-fff2982472de service nova] Creating event network-changed:1e547ec7-7efd-480f-84be-806c8cf25b90 for instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e on user Apr 14 11:01:04 user devstack@n-api.service[61840]: DEBUG nova.compute.api [req-a47a0597-fc65-442b-a754-a86573205079 req-83e71df9-cf59-4fd8-8bf7-fff2982472de service nova] Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61840) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 11:01:04 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-a47a0597-fc65-442b-a754-a86573205079 req-83e71df9-cf59-4fd8-8bf7-fff2982472de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038886 Apr 14 11:01:04 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 284/852] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:06 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db2e71c-939b-4d2f-b1be-c2122f7cd73e", "name": "network-vif-unplugged", "status": "completed", "tag": "1e547ec7-7efd-480f-84be-806c8cf25b90"}, {"server_uuid": "3db2e71c-939b-4d2f-b1be-c2122f7cd73e", "name": "network-vif-plugged", "status": "completed", "tag": "1e547ec7-7efd-480f-84be-806c8cf25b90"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:06 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:06 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:06 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:06 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] Creating event network-vif-unplugged:1e547ec7-7efd-480f-84be-806c8cf25b90 for instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e on user Apr 14 11:01:06 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] Creating event network-vif-plugged:1e547ec7-7efd-480f-84be-806c8cf25b90 for instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e on user Apr 14 11:01:06 user devstack@n-api.service[61839]: DEBUG nova.compute.api [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61839) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 11:01:06 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.063790 Apr 14 11:01:06 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 284/853] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:06 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:09 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-229cc710-f33a-4bf8-82e6-72565b75a6aa tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:09 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-229cc710-f33a-4bf8-82e6-72565b75a6aa tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-229cc710-f33a-4bf8-82e6-72565b75a6aa tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-229cc710-f33a-4bf8-82e6-72565b75a6aa tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-229cc710-f33a-4bf8-82e6-72565b75a6aa tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-229cc710-f33a-4bf8-82e6-72565b75a6aa tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-229cc710-f33a-4bf8-82e6-72565b75a6aa tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-229cc710-f33a-4bf8-82e6-72565b75a6aa tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:09 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-229cc710-f33a-4bf8-82e6-72565b75a6aa tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] HTTP exception thrown: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. Apr 14 11:01:09 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-229cc710-f33a-4bf8-82e6-72565b75a6aa tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Request method failure captured: Apr 14 11:01:09 user devstack@n-api.service[61841]: request: DELETE /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e HTTP/1.1 Apr 14 11:01:09 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:01:09 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:01:09 user devstack@n-api.service[61841]: Connection: close Apr 14 11:01:09 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:01:09 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:01:09 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:01:09 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:01:09 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:01:09 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS84vM36G7Nioj-ToQvoMdFXKF2xLhh7C9a3nbB4y18IkUJEogQn474a0MLG191bnwycwvsi0zS8LTGssOiGIEYNvHQjgijI-jHv2hvRRh1UXWy8xpVhO7o4yY1wPKzSfRxurp_fOMRnE8XRArHY8IVEqoNbCj4XRAQxEHh0XdXxD38 Apr 14 11:01:09 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:01:09 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:01:09 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:01:09 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:01:09 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:01:09 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:01:09 user devstack@n-api.service[61841]: X-Project-Id: eb9b9fc4f2e244879502006bb844761c Apr 14 11:01:09 user devstack@n-api.service[61841]: X-Project-Name: tempest-AttachVolumeTestJSON-821788322 Apr 14 11:01:09 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:01:09 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:01:09 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb9b9fc4f2e244879502006bb844761c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb9b9fc4f2e244879502006bb844761c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb9b9fc4f2e244879502006bb844761c"}]}] Apr 14 11:01:09 user devstack@n-api.service[61841]: X-Tenant: tempest-AttachVolumeTestJSON-821788322 Apr 14 11:01:09 user devstack@n-api.service[61841]: X-Tenant-Id: eb9b9fc4f2e244879502006bb844761c Apr 14 11:01:09 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821788322 Apr 14 11:01:09 user devstack@n-api.service[61841]: X-User: tempest-AttachVolumeTestJSON-821788322-project-member Apr 14 11:01:09 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:01:09 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:01:09 user devstack@n-api.service[61841]: X-User-Id: 11cb4a1e78d447dbb18cde5453fe499c Apr 14 11:01:09 user devstack@n-api.service[61841]: X-User-Name: tempest-AttachVolumeTestJSON-821788322-project-member Apr 14 11:01:09 user devstack@n-api.service[61841]: method: > Apr 14 11:01:09 user devstack@n-api.service[61841]: exception: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. Apr 14 11:01:09 user devstack@n-api.service[61841]: action_args: {'id': '0bb99276-64ba-4641-8869-3f35eea2f76e'} Apr 14 11:01:09 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. Apr 14 11:01:09 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:01:09 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-229cc710-f33a-4bf8-82e6-72565b75a6aa tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Returning 404 to user: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:01:09 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-229cc710-f33a-4bf8-82e6-72565b75a6aa tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e" status: 404 len: 111 microversion: 2.1 time: 0.031641 Apr 14 11:01:09 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 286/854] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:01:09 2023] DELETE /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:01:09 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-40471d3e-209a-40a6-acb3-a735f43cf63a tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:09 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-40471d3e-209a-40a6-acb3-a735f43cf63a tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:09 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:09 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-40471d3e-209a-40a6-acb3-a735f43cf63a tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:09 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-40471d3e-209a-40a6-acb3-a735f43cf63a tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:09 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-40471d3e-209a-40a6-acb3-a735f43cf63a tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:09 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-40471d3e-209a-40a6-acb3-a735f43cf63a tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:09 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-40471d3e-209a-40a6-acb3-a735f43cf63a tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:09 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-40471d3e-209a-40a6-acb3-a735f43cf63a tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:09 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-40471d3e-209a-40a6-acb3-a735f43cf63a tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] HTTP exception thrown: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. Apr 14 11:01:09 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-40471d3e-209a-40a6-acb3-a735f43cf63a tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Request method failure captured: Apr 14 11:01:09 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e HTTP/1.1 Apr 14 11:01:09 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:01:09 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:01:09 user devstack@n-api.service[61840]: Connection: close Apr 14 11:01:09 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:01:09 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:01:09 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:01:09 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:01:09 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:01:09 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS84vM36G7Nioj-ToQvoMdFXKF2xLhh7C9a3nbB4y18IkUJEogQn474a0MLG191bnwycwvsi0zS8LTGssOiGIEYNvHQjgijI-jHv2hvRRh1UXWy8xpVhO7o4yY1wPKzSfRxurp_fOMRnE8XRArHY8IVEqoNbCj4XRAQxEHh0XdXxD38 Apr 14 11:01:09 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:01:09 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:01:09 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:01:09 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:01:09 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:01:09 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:01:09 user devstack@n-api.service[61840]: X-Project-Id: eb9b9fc4f2e244879502006bb844761c Apr 14 11:01:09 user devstack@n-api.service[61840]: X-Project-Name: tempest-AttachVolumeTestJSON-821788322 Apr 14 11:01:09 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:01:09 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:01:09 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb9b9fc4f2e244879502006bb844761c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb9b9fc4f2e244879502006bb844761c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb9b9fc4f2e244879502006bb844761c"}]}] Apr 14 11:01:09 user devstack@n-api.service[61840]: X-Tenant: tempest-AttachVolumeTestJSON-821788322 Apr 14 11:01:09 user devstack@n-api.service[61840]: X-Tenant-Id: eb9b9fc4f2e244879502006bb844761c Apr 14 11:01:09 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821788322 Apr 14 11:01:09 user devstack@n-api.service[61840]: X-User: tempest-AttachVolumeTestJSON-821788322-project-member Apr 14 11:01:09 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:01:09 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:01:09 user devstack@n-api.service[61840]: X-User-Id: 11cb4a1e78d447dbb18cde5453fe499c Apr 14 11:01:09 user devstack@n-api.service[61840]: X-User-Name: tempest-AttachVolumeTestJSON-821788322-project-member Apr 14 11:01:09 user devstack@n-api.service[61840]: method: > Apr 14 11:01:09 user devstack@n-api.service[61840]: exception: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. Apr 14 11:01:09 user devstack@n-api.service[61840]: action_args: {'id': '0bb99276-64ba-4641-8869-3f35eea2f76e'} Apr 14 11:01:09 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. Apr 14 11:01:09 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:09 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-40471d3e-209a-40a6-acb3-a735f43cf63a tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Returning 404 to user: Instance 0bb99276-64ba-4641-8869-3f35eea2f76e could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:01:09 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-40471d3e-209a-40a6-acb3-a735f43cf63a tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e" status: 404 len: 111 microversion: 2.1 time: 0.047714 Apr 14 11:01:09 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 285/855] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:01:09 2023] GET /compute/v2.1/servers/0bb99276-64ba-4641-8869-3f35eea2f76e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:01:15 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=3 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:15 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-818ab1f4-df7b-4c73-8acd-4382b41334af tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:15 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-818ab1f4-df7b-4c73-8acd-4382b41334af tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-818ab1f4-df7b-4c73-8acd-4382b41334af tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-818ab1f4-df7b-4c73-8acd-4382b41334af tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-818ab1f4-df7b-4c73-8acd-4382b41334af tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-818ab1f4-df7b-4c73-8acd-4382b41334af tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-818ab1f4-df7b-4c73-8acd-4382b41334af tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-818ab1f4-df7b-4c73-8acd-4382b41334af tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:15 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-818ab1f4-df7b-4c73-8acd-4382b41334af tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058483 Apr 14 11:01:15 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 285/856] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:01:15 2023] GET /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 11:01:15 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a3c04638-57b4-46f5-9124-6c75cc94dd45 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:15 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-a3c04638-57b4-46f5-9124-6c75cc94dd45 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3c04638-57b4-46f5-9124-6c75cc94dd45 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3c04638-57b4-46f5-9124-6c75cc94dd45 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3c04638-57b4-46f5-9124-6c75cc94dd45 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3c04638-57b4-46f5-9124-6c75cc94dd45 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3c04638-57b4-46f5-9124-6c75cc94dd45 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:15 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a3c04638-57b4-46f5-9124-6c75cc94dd45 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:15 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-a3c04638-57b4-46f5-9124-6c75cc94dd45 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] HTTP exception thrown: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. Apr 14 11:01:15 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a3c04638-57b4-46f5-9124-6c75cc94dd45 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Request method failure captured: Apr 14 11:01:15 user devstack@n-api.service[61841]: request: DELETE /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 HTTP/1.1 Apr 14 11:01:15 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:01:15 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:01:15 user devstack@n-api.service[61841]: Connection: close Apr 14 11:01:15 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:01:15 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:01:15 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:01:15 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:01:15 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:01:15 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS84vM36G7Nioj-ToQvoMdFXKF2xLhh7C9a3nbB4y18IkUJEogQn474a0MLG191bnwycwvsi0zS8LTGssOiGIEYNvHQjgijI-jHv2hvRRh1UXWy8xpVhO7o4yY1wPKzSfRxurp_fOMRnE8XRArHY8IVEqoNbCj4XRAQxEHh0XdXxD38 Apr 14 11:01:15 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:01:15 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:01:15 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:01:15 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:01:15 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:01:15 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:01:15 user devstack@n-api.service[61841]: X-Project-Id: eb9b9fc4f2e244879502006bb844761c Apr 14 11:01:15 user devstack@n-api.service[61841]: X-Project-Name: tempest-AttachVolumeTestJSON-821788322 Apr 14 11:01:15 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:01:15 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:01:15 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb9b9fc4f2e244879502006bb844761c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb9b9fc4f2e244879502006bb844761c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb9b9fc4f2e244879502006bb844761c"}]}] Apr 14 11:01:15 user devstack@n-api.service[61841]: X-Tenant: tempest-AttachVolumeTestJSON-821788322 Apr 14 11:01:15 user devstack@n-api.service[61841]: X-Tenant-Id: eb9b9fc4f2e244879502006bb844761c Apr 14 11:01:15 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821788322 Apr 14 11:01:15 user devstack@n-api.service[61841]: X-User: tempest-AttachVolumeTestJSON-821788322-project-member Apr 14 11:01:15 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:01:15 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:01:15 user devstack@n-api.service[61841]: X-User-Id: 11cb4a1e78d447dbb18cde5453fe499c Apr 14 11:01:15 user devstack@n-api.service[61841]: X-User-Name: tempest-AttachVolumeTestJSON-821788322-project-member Apr 14 11:01:15 user devstack@n-api.service[61841]: method: > Apr 14 11:01:15 user devstack@n-api.service[61841]: exception: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. Apr 14 11:01:15 user devstack@n-api.service[61841]: action_args: {'id': '8586a70e-9855-4177-ac1b-cf707a4df871'} Apr 14 11:01:15 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. Apr 14 11:01:15 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:01:15 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a3c04638-57b4-46f5-9124-6c75cc94dd45 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Returning 404 to user: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:01:15 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a3c04638-57b4-46f5-9124-6c75cc94dd45 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871" status: 404 len: 111 microversion: 2.1 time: 0.031556 Apr 14 11:01:15 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 287/857] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:01:15 2023] DELETE /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:01:15 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-3988d911-e18a-448c-9462-eb7aea58fd46 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:15 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-3988d911-e18a-448c-9462-eb7aea58fd46 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:15 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3988d911-e18a-448c-9462-eb7aea58fd46 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:15 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3988d911-e18a-448c-9462-eb7aea58fd46 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:15 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3988d911-e18a-448c-9462-eb7aea58fd46 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:15 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3988d911-e18a-448c-9462-eb7aea58fd46 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:15 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3988d911-e18a-448c-9462-eb7aea58fd46 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:15 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3988d911-e18a-448c-9462-eb7aea58fd46 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:15 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-3988d911-e18a-448c-9462-eb7aea58fd46 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] HTTP exception thrown: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. Apr 14 11:01:15 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-3988d911-e18a-448c-9462-eb7aea58fd46 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Request method failure captured: Apr 14 11:01:15 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 HTTP/1.1 Apr 14 11:01:15 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:01:15 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:01:15 user devstack@n-api.service[61840]: Connection: close Apr 14 11:01:15 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:01:15 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:01:15 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:01:15 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:01:15 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:01:15 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS84vM36G7Nioj-ToQvoMdFXKF2xLhh7C9a3nbB4y18IkUJEogQn474a0MLG191bnwycwvsi0zS8LTGssOiGIEYNvHQjgijI-jHv2hvRRh1UXWy8xpVhO7o4yY1wPKzSfRxurp_fOMRnE8XRArHY8IVEqoNbCj4XRAQxEHh0XdXxD38 Apr 14 11:01:15 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:01:15 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:01:15 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:01:15 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:01:15 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:01:15 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:01:15 user devstack@n-api.service[61840]: X-Project-Id: eb9b9fc4f2e244879502006bb844761c Apr 14 11:01:15 user devstack@n-api.service[61840]: X-Project-Name: tempest-AttachVolumeTestJSON-821788322 Apr 14 11:01:15 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:01:15 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:01:15 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb9b9fc4f2e244879502006bb844761c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb9b9fc4f2e244879502006bb844761c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb9b9fc4f2e244879502006bb844761c"}]}] Apr 14 11:01:15 user devstack@n-api.service[61840]: X-Tenant: tempest-AttachVolumeTestJSON-821788322 Apr 14 11:01:15 user devstack@n-api.service[61840]: X-Tenant-Id: eb9b9fc4f2e244879502006bb844761c Apr 14 11:01:15 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821788322 Apr 14 11:01:15 user devstack@n-api.service[61840]: X-User: tempest-AttachVolumeTestJSON-821788322-project-member Apr 14 11:01:15 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:01:15 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:01:15 user devstack@n-api.service[61840]: X-User-Id: 11cb4a1e78d447dbb18cde5453fe499c Apr 14 11:01:15 user devstack@n-api.service[61840]: X-User-Name: tempest-AttachVolumeTestJSON-821788322-project-member Apr 14 11:01:15 user devstack@n-api.service[61840]: method: > Apr 14 11:01:15 user devstack@n-api.service[61840]: exception: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. Apr 14 11:01:15 user devstack@n-api.service[61840]: action_args: {'id': '8586a70e-9855-4177-ac1b-cf707a4df871'} Apr 14 11:01:15 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. Apr 14 11:01:15 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:15 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-3988d911-e18a-448c-9462-eb7aea58fd46 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Returning 404 to user: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:01:15 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-3988d911-e18a-448c-9462-eb7aea58fd46 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871" status: 404 len: 111 microversion: 2.1 time: 0.039832 Apr 14 11:01:15 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 286/858] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:01:15 2023] GET /compute/v2.1/servers/8586a70e-9855-4177-ac1b-cf707a4df871 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:01:16 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:16 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:16 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-aa2b0b20-a6a5-43b8-95b7-f23f7c19bc46 req-3e04d5c3-0ec7-45bd-8d5f-52b8225d7f49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6a53c3-6e32-456c-a056-fbf1bef3b656", "tag": "c18cf2ba-f230-4684-a95c-14af689d7981"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:16 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-aa2b0b20-a6a5-43b8-95b7-f23f7c19bc46 req-3e04d5c3-0ec7-45bd-8d5f-52b8225d7f49 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-aa2b0b20-a6a5-43b8-95b7-f23f7c19bc46 req-3e04d5c3-0ec7-45bd-8d5f-52b8225d7f49 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-aa2b0b20-a6a5-43b8-95b7-f23f7c19bc46 req-3e04d5c3-0ec7-45bd-8d5f-52b8225d7f49 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:16 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-aa2b0b20-a6a5-43b8-95b7-f23f7c19bc46 req-3e04d5c3-0ec7-45bd-8d5f-52b8225d7f49 service nova] Creating event network-changed:c18cf2ba-f230-4684-a95c-14af689d7981 for instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 on user Apr 14 11:01:16 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-aa2b0b20-a6a5-43b8-95b7-f23f7c19bc46 req-3e04d5c3-0ec7-45bd-8d5f-52b8225d7f49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052182 Apr 14 11:01:16 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:01:16 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 288/859] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:16 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656" status: 204 len: 0 microversion: 2.1 time: 0.145110 Apr 14 11:01:16 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 286/860] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:01:16 2023] DELETE /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:01:16 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-92e4e51c-3a75-4b59-9937-81784a8f09ac tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:16 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-92e4e51c-3a75-4b59-9937-81784a8f09ac tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-92e4e51c-3a75-4b59-9937-81784a8f09ac tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-92e4e51c-3a75-4b59-9937-81784a8f09ac tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-92e4e51c-3a75-4b59-9937-81784a8f09ac tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-92e4e51c-3a75-4b59-9937-81784a8f09ac tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-92e4e51c-3a75-4b59-9937-81784a8f09ac tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-92e4e51c-3a75-4b59-9937-81784a8f09ac tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:16 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-92e4e51c-3a75-4b59-9937-81784a8f09ac tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ad6531a67b4be58a195e1208157b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629ba0ab8074ed8bb4e59d545b74eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:01:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-92e4e51c-3a75-4b59-9937-81784a8f09ac tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656" status: 200 len: 1660 microversion: 2.1 time: 0.334809 Apr 14 11:01:16 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 287/861] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:01:16 2023] GET /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656 => generated 1660 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:01:17 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-59ada0cc-1e47-4969-9b12-370b82081312 req-f7e9557d-1afc-457c-a1fc-673cdfd6047c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6a53c3-6e32-456c-a056-fbf1bef3b656", "name": "network-vif-unplugged", "status": "completed", "tag": "c18cf2ba-f230-4684-a95c-14af689d7981"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-59ada0cc-1e47-4969-9b12-370b82081312 req-f7e9557d-1afc-457c-a1fc-673cdfd6047c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-59ada0cc-1e47-4969-9b12-370b82081312 req-f7e9557d-1afc-457c-a1fc-673cdfd6047c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-59ada0cc-1e47-4969-9b12-370b82081312 req-f7e9557d-1afc-457c-a1fc-673cdfd6047c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:17 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-59ada0cc-1e47-4969-9b12-370b82081312 req-f7e9557d-1afc-457c-a1fc-673cdfd6047c service nova] Creating event network-vif-unplugged:c18cf2ba-f230-4684-a95c-14af689d7981 for instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 on user Apr 14 11:01:17 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-59ada0cc-1e47-4969-9b12-370b82081312 req-f7e9557d-1afc-457c-a1fc-673cdfd6047c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045130 Apr 14 11:01:17 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 289/862] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:18 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db2e71c-939b-4d2f-b1be-c2122f7cd73e", "name": "network-vif-plugged", "status": "completed", "tag": "1e547ec7-7efd-480f-84be-806c8cf25b90"}, {"server_uuid": "3db2e71c-939b-4d2f-b1be-c2122f7cd73e", "name": "network-vif-plugged", "status": "completed", "tag": "1e547ec7-7efd-480f-84be-806c8cf25b90"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:18 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:18 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] Creating event network-vif-plugged:1e547ec7-7efd-480f-84be-806c8cf25b90 for instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e on user Apr 14 11:01:18 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] Creating event network-vif-plugged:1e547ec7-7efd-480f-84be-806c8cf25b90 for instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e on user Apr 14 11:01:18 user devstack@n-api.service[61839]: DEBUG nova.compute.api [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61839) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 11:01:18 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057274 Apr 14 11:01:18 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 287/863] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:18 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-6ed74698-87b4-4255-ad43-797b1bc18e4e req-f7d89cbe-8439-447e-b810-585127d087e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6a53c3-6e32-456c-a056-fbf1bef3b656", "name": "network-vif-deleted", "tag": "c18cf2ba-f230-4684-a95c-14af689d7981"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6ed74698-87b4-4255-ad43-797b1bc18e4e req-f7d89cbe-8439-447e-b810-585127d087e0 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6ed74698-87b4-4255-ad43-797b1bc18e4e req-f7d89cbe-8439-447e-b810-585127d087e0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-6ed74698-87b4-4255-ad43-797b1bc18e4e req-f7d89cbe-8439-447e-b810-585127d087e0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-6ed74698-87b4-4255-ad43-797b1bc18e4e req-f7d89cbe-8439-447e-b810-585127d087e0 service nova] Creating event network-vif-deleted:c18cf2ba-f230-4684-a95c-14af689d7981 for instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 on user Apr 14 11:01:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-6ed74698-87b4-4255-ad43-797b1bc18e4e req-f7d89cbe-8439-447e-b810-585127d087e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039922 Apr 14 11:01:18 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 288/864] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:19 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6a53c3-6e32-456c-a056-fbf1bef3b656", "name": "network-vif-plugged", "status": "completed", "tag": "c18cf2ba-f230-4684-a95c-14af689d7981"}, {"server_uuid": "3d6a53c3-6e32-456c-a056-fbf1bef3b656", "name": "network-vif-plugged", "status": "completed", "tag": "c18cf2ba-f230-4684-a95c-14af689d7981"}, {"server_uuid": "3d6a53c3-6e32-456c-a056-fbf1bef3b656", "name": "network-vif-plugged", "status": "completed", "tag": "c18cf2ba-f230-4684-a95c-14af689d7981"}, {"server_uuid": "3d6a53c3-6e32-456c-a056-fbf1bef3b656", "name": "network-vif-plugged", "status": "completed", "tag": "c18cf2ba-f230-4684-a95c-14af689d7981"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:19 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Creating event network-vif-plugged:c18cf2ba-f230-4684-a95c-14af689d7981 for instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 on user Apr 14 11:01:19 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Creating event network-vif-plugged:c18cf2ba-f230-4684-a95c-14af689d7981 for instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 on user Apr 14 11:01:19 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Creating event network-vif-plugged:c18cf2ba-f230-4684-a95c-14af689d7981 for instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 on user Apr 14 11:01:19 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Creating event network-vif-plugged:c18cf2ba-f230-4684-a95c-14af689d7981 for instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 on user Apr 14 11:01:19 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.062116 Apr 14 11:01:19 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 290/865] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:19 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-90735481", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "networks": [{"uuid": "9614cf7a-420b-4226-9189-a89f3f4e6340"}]}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] validate_networks() for [('9614cf7a-420b-4226-9189-a89f3f4e6340', None, None, None, None, None)] {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Getting quotas for project 1310da753ca94b38a7c660b8613af044. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Getting quotas for user 282af802879e463ea87844b5fc926692 and project 1310da753ca94b38a7c660b8613af044. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:01:29 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:01:29 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.586217 Apr 14 11:01:29 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 288/866] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:01:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:01:29 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=7 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:29 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=30 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:29 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-9ea28efc-fe7d-424f-aaa7-3af3c2a3f671 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:29 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-9ea28efc-fe7d-424f-aaa7-3af3c2a3f671 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:29 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-9ea28efc-fe7d-424f-aaa7-3af3c2a3f671 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282af802879e463ea87844b5fc926692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310da753ca94b38a7c660b8613af044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:01:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-9ea28efc-fe7d-424f-aaa7-3af3c2a3f671 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d70b388-155f-4e47-8352-b69c856b2000" status: 200 len: 1206 microversion: 2.1 time: 0.092941 Apr 14 11:01:29 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 289/867] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:01:29 2023] GET /compute/v2.1/servers/3d70b388-155f-4e47-8352-b69c856b2000 => generated 1206 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:01:30 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=16 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:30 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=22 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:30 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e50f65f3-dd42-41fe-8a95-be7c0d7350a5 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:30 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-e50f65f3-dd42-41fe-8a95-be7c0d7350a5 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e50f65f3-dd42-41fe-8a95-be7c0d7350a5 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e50f65f3-dd42-41fe-8a95-be7c0d7350a5 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e50f65f3-dd42-41fe-8a95-be7c0d7350a5 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e50f65f3-dd42-41fe-8a95-be7c0d7350a5 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e50f65f3-dd42-41fe-8a95-be7c0d7350a5 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e50f65f3-dd42-41fe-8a95-be7c0d7350a5 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:30 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-e50f65f3-dd42-41fe-8a95-be7c0d7350a5 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:01:30 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-e50f65f3-dd42-41fe-8a95-be7c0d7350a5 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:01:30 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-e50f65f3-dd42-41fe-8a95-be7c0d7350a5 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:01:30 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-e50f65f3-dd42-41fe-8a95-be7c0d7350a5 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177" status: 200 len: 1756 microversion: 2.87 time: 0.180278 Apr 14 11:01:30 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 291/868] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:01:30 2023] GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:01:32 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-41c95a98-4ca3-417f-9e67-8181cf63bc05 req-7b3ca40b-9b82-40df-924d-5a5aee99482a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d70b388-155f-4e47-8352-b69c856b2000", "tag": "77c6475d-8834-422b-ab62-0bd935284c56"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-41c95a98-4ca3-417f-9e67-8181cf63bc05 req-7b3ca40b-9b82-40df-924d-5a5aee99482a service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-41c95a98-4ca3-417f-9e67-8181cf63bc05 req-7b3ca40b-9b82-40df-924d-5a5aee99482a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-41c95a98-4ca3-417f-9e67-8181cf63bc05 req-7b3ca40b-9b82-40df-924d-5a5aee99482a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:32 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-41c95a98-4ca3-417f-9e67-8181cf63bc05 req-7b3ca40b-9b82-40df-924d-5a5aee99482a service nova] Creating event network-changed:77c6475d-8834-422b-ab62-0bd935284c56 for instance 3d70b388-155f-4e47-8352-b69c856b2000 on user Apr 14 11:01:32 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-41c95a98-4ca3-417f-9e67-8181cf63bc05 req-7b3ca40b-9b82-40df-924d-5a5aee99482a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037490 Apr 14 11:01:32 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 289/869] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:34 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-392369322", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "networks": [{"uuid": "32b79070-3f05-4fa8-90ea-ba2ba6953db2"}]}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:34 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] validate_networks() for [('32b79070-3f05-4fa8-90ea-ba2ba6953db2', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:01:34 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-358a8d15-accd-4d55-9b2f-fdd8fee15d66 req-3b42890e-7713-4a78-9aee-6c0cd6b89318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d70b388-155f-4e47-8352-b69c856b2000", "name": "network-vif-plugged", "status": "completed", "tag": "77c6475d-8834-422b-ab62-0bd935284c56"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-358a8d15-accd-4d55-9b2f-fdd8fee15d66 req-3b42890e-7713-4a78-9aee-6c0cd6b89318 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-358a8d15-accd-4d55-9b2f-fdd8fee15d66 req-3b42890e-7713-4a78-9aee-6c0cd6b89318 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-358a8d15-accd-4d55-9b2f-fdd8fee15d66 req-3b42890e-7713-4a78-9aee-6c0cd6b89318 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:34 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:01:34 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:01:34 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:01:34 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:01:34 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:01:34 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-358a8d15-accd-4d55-9b2f-fdd8fee15d66 req-3b42890e-7713-4a78-9aee-6c0cd6b89318 service nova] Creating event network-vif-plugged:77c6475d-8834-422b-ab62-0bd935284c56 for instance 3d70b388-155f-4e47-8352-b69c856b2000 on user Apr 14 11:01:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:34 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-358a8d15-accd-4d55-9b2f-fdd8fee15d66 req-3b42890e-7713-4a78-9aee-6c0cd6b89318 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059505 Apr 14 11:01:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:34 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 292/870] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:35 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Getting quotas for project 000980e0e886468b8df32c7373cde033. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:01:35 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Getting quotas for user c9ae4725537b4162b88b3eed27666bc0 and project 000980e0e886468b8df32c7373cde033. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:01:35 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:01:35 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:01:35 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.950609 Apr 14 11:01:35 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 290/871] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:01:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:01:35 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-d4a8350d-8672-44f5-941d-0094363eea96 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:35 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-d4a8350d-8672-44f5-941d-0094363eea96 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:35 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-d4a8350d-8672-44f5-941d-0094363eea96 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae4725537b4162b88b3eed27666bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '000980e0e886468b8df32c7373cde033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:01:35 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-d4a8350d-8672-44f5-941d-0094363eea96 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" status: 200 len: 1207 microversion: 2.1 time: 0.090430 Apr 14 11:01:35 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 290/872] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:01:35 2023] GET /compute/v2.1/servers/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba => generated 1207 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:01:37 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-5423d9db-7c98-4e9f-a52c-3ce50774db93 req-8e230db5-07c6-49a4-9cd1-e85c14211f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d70b388-155f-4e47-8352-b69c856b2000", "name": "network-vif-plugged", "status": "completed", "tag": "77c6475d-8834-422b-ab62-0bd935284c56"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:37 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5423d9db-7c98-4e9f-a52c-3ce50774db93 req-8e230db5-07c6-49a4-9cd1-e85c14211f05 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:37 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5423d9db-7c98-4e9f-a52c-3ce50774db93 req-8e230db5-07c6-49a4-9cd1-e85c14211f05 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:37 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5423d9db-7c98-4e9f-a52c-3ce50774db93 req-8e230db5-07c6-49a4-9cd1-e85c14211f05 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:37 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-5423d9db-7c98-4e9f-a52c-3ce50774db93 req-8e230db5-07c6-49a4-9cd1-e85c14211f05 service nova] Creating event network-vif-plugged:77c6475d-8834-422b-ab62-0bd935284c56 for instance 3d70b388-155f-4e47-8352-b69c856b2000 on user Apr 14 11:01:37 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-5423d9db-7c98-4e9f-a52c-3ce50774db93 req-8e230db5-07c6-49a4-9cd1-e85c14211f05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032439 Apr 14 11:01:37 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 293/873] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:37 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d5f0965d-4a47-490c-9ac1-5b16371ada9a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:37 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-d5f0965d-4a47-490c-9ac1-5b16371ada9a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:37 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d5f0965d-4a47-490c-9ac1-5b16371ada9a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:37 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d5f0965d-4a47-490c-9ac1-5b16371ada9a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:37 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d5f0965d-4a47-490c-9ac1-5b16371ada9a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:37 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d5f0965d-4a47-490c-9ac1-5b16371ada9a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:37 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d5f0965d-4a47-490c-9ac1-5b16371ada9a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:37 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d5f0965d-4a47-490c-9ac1-5b16371ada9a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:37 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-d5f0965d-4a47-490c-9ac1-5b16371ada9a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HTTP exception thrown: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. Apr 14 11:01:37 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d5f0965d-4a47-490c-9ac1-5b16371ada9a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Request method failure captured: Apr 14 11:01:37 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94 HTTP/1.1 Apr 14 11:01:37 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:01:37 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:01:37 user devstack@n-api.service[61840]: Connection: close Apr 14 11:01:37 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:01:37 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:01:37 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:01:37 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:01:37 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:01:37 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTAm6v8qUESI0IjizmIjmsJWXGLOjjeSrv09ri2T6RAbvAYajYyIrxw22PgYPfP-sFhLjBYVsJQMKmp7KoYSOSHZjTqklYHtEK1WW90dx3jL-AC6Ab0TV_VkQ0gzFfhCxphVnwf0RVdI8bvNKr-C_80J359JrotPIMB_M0XXXvYIzcQ Apr 14 11:01:37 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:01:37 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:01:37 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:01:37 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:01:37 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:01:37 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:01:37 user devstack@n-api.service[61840]: X-Project-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:01:37 user devstack@n-api.service[61840]: X-Project-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:01:37 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:01:37 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:01:37 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}] Apr 14 11:01:37 user devstack@n-api.service[61840]: X-Tenant: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:01:37 user devstack@n-api.service[61840]: X-Tenant-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:01:37 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:01:37 user devstack@n-api.service[61840]: X-User: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:01:37 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:01:37 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:01:37 user devstack@n-api.service[61840]: X-User-Id: 78adbbdcd10e446daddde754e46309b2 Apr 14 11:01:37 user devstack@n-api.service[61840]: X-User-Name: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:01:37 user devstack@n-api.service[61840]: method: > Apr 14 11:01:37 user devstack@n-api.service[61840]: exception: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. Apr 14 11:01:37 user devstack@n-api.service[61840]: action_args: {'id': 'ef413492-c781-459e-b99c-46a530034c94'} Apr 14 11:01:37 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. Apr 14 11:01:37 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:01:37 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d5f0965d-4a47-490c-9ac1-5b16371ada9a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Returning 404 to user: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:01:37 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d5f0965d-4a47-490c-9ac1-5b16371ada9a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94" status: 404 len: 111 microversion: 2.1 time: 0.031130 Apr 14 11:01:37 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 291/874] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:01:37 2023] GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:01:37 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-31bc07d0-78d2-48ac-b18b-8df64c012f4f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '.version_select at 0x7fcd1d2993f0>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:37 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-31bc07d0-78d2-48ac-b18b-8df64c012f4f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-880478313" status: 202 len: 0 microversion: 2.1 time: 0.021475 Apr 14 11:01:37 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 291/875] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 11:01:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-880478313 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:01:38 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-0dc84372-ea13-4fb9-9f18-8bc6e7854b49 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Action: 'create', calling method: .version_select at 0x7fcd1cfb9090>, body: {"keypair": {"name": "tempest-keypair-1834404942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUMt0cUlOh1dr6H24aOsI+tMVji84u3t7+LMjK6oGFZgRyd4eLIdFiX15GuGpnHHIIOHuFjVOsPnQ4vCH+2At3po6hk4ZhK8XpaMubuDoAKWSrrVyVLSqgOoqGX6zYnBA=="}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:38 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-2d77909b-703e-4454-a575-417874a25442 req-21207653-2640-426b-ad79-1d4f1cc62ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba", "tag": "2b800e13-6dff-47b1-aced-1f9b2600868f"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-2d77909b-703e-4454-a575-417874a25442 req-21207653-2640-426b-ad79-1d4f1cc62ac2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-2d77909b-703e-4454-a575-417874a25442 req-21207653-2640-426b-ad79-1d4f1cc62ac2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-2d77909b-703e-4454-a575-417874a25442 req-21207653-2640-426b-ad79-1d4f1cc62ac2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:38 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-0dc84372-ea13-4fb9-9f18-8bc6e7854b49 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for project cb8f294f957f4c74ae959c1e9f238427. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:01:38 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-0dc84372-ea13-4fb9-9f18-8bc6e7854b49 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for user 78adbbdcd10e446daddde754e46309b2 and project cb8f294f957f4c74ae959c1e9f238427. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:01:38 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-2d77909b-703e-4454-a575-417874a25442 req-21207653-2640-426b-ad79-1d4f1cc62ac2 service nova] Creating event network-changed:2b800e13-6dff-47b1-aced-1f9b2600868f for instance a1fdcfb4-8700-48fe-9dec-1e8a4b766cba on user Apr 14 11:01:38 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-2d77909b-703e-4454-a575-417874a25442 req-21207653-2640-426b-ad79-1d4f1cc62ac2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034131 Apr 14 11:01:38 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 292/876] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:38 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-0dc84372-ea13-4fb9-9f18-8bc6e7854b49 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059922 Apr 14 11:01:38 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 294/877] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 11:01:38 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:40 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:40 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-391849424", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b639a68a-2b4e-435c-b98b-65b5b4981c73"}], "security_groups": [{"name": "tempest-securitygroup--1663021442"}], "key_name": "tempest-keypair-1834404942", "user_data": "}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-a765119a-9ddd-46c0-aa98-67715853b334 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:40 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-a765119a-9ddd-46c0-aa98-67715853b334 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a765119a-9ddd-46c0-aa98-67715853b334 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a765119a-9ddd-46c0-aa98-67715853b334 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a765119a-9ddd-46c0-aa98-67715853b334 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a765119a-9ddd-46c0-aa98-67715853b334 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a765119a-9ddd-46c0-aa98-67715853b334 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a765119a-9ddd-46c0-aa98-67715853b334 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:40 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] validate_networks() for [('b639a68a-2b4e-435c-b98b-65b5b4981c73', None, None, None, None, None)] {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:01:40 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-a765119a-9ddd-46c0-aa98-67715853b334 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f2157c5d4d441db80ea4a3ca60e4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1c0764b8a843808158644eb90704e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:01:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-a765119a-9ddd-46c0-aa98-67715853b334 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96" status: 200 len: 1495 microversion: 2.1 time: 0.225054 Apr 14 11:01:40 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 293/878] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:01:40 2023] GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96 => generated 1495 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:01:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-7456fdcc-47ba-4c24-a105-3d94a37ec944 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:40 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-7456fdcc-47ba-4c24-a105-3d94a37ec944 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7456fdcc-47ba-4c24-a105-3d94a37ec944 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7456fdcc-47ba-4c24-a105-3d94a37ec944 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7456fdcc-47ba-4c24-a105-3d94a37ec944 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7456fdcc-47ba-4c24-a105-3d94a37ec944 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7456fdcc-47ba-4c24-a105-3d94a37ec944 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7456fdcc-47ba-4c24-a105-3d94a37ec944 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:41 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:01:41 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:01:41 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:01:41 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:01:41 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:01:41 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-7456fdcc-47ba-4c24-a105-3d94a37ec944 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:01:41 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-7456fdcc-47ba-4c24-a105-3d94a37ec944 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" status: 200 len: 1535 microversion: 2.1 time: 0.161751 Apr 14 11:01:41 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 295/879] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:01:40 2023] GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => generated 1535 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:01:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:41 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for project cb8f294f957f4c74ae959c1e9f238427. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:01:41 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting quotas for user 78adbbdcd10e446daddde754e46309b2 and project cb8f294f957f4c74ae959c1e9f238427. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:01:41 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-9cfeae2a-7c09-4dd4-974e-5350c00ae407 req-59d86223-33b3-4766-b7e5-c0944eb130b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba", "name": "network-vif-plugged", "status": "completed", "tag": "2b800e13-6dff-47b1-aced-1f9b2600868f"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:41 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:01:41 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:01:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-9cfeae2a-7c09-4dd4-974e-5350c00ae407 req-59d86223-33b3-4766-b7e5-c0944eb130b8 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-9cfeae2a-7c09-4dd4-974e-5350c00ae407 req-59d86223-33b3-4766-b7e5-c0944eb130b8 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-9cfeae2a-7c09-4dd4-974e-5350c00ae407 req-59d86223-33b3-4766-b7e5-c0944eb130b8 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-9cfeae2a-7c09-4dd4-974e-5350c00ae407 req-59d86223-33b3-4766-b7e5-c0944eb130b8 service nova] Creating event network-vif-plugged:2b800e13-6dff-47b1-aced-1f9b2600868f for instance a1fdcfb4-8700-48fe-9dec-1e8a4b766cba on user Apr 14 11:01:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-9cfeae2a-7c09-4dd4-974e-5350c00ae407 req-59d86223-33b3-4766-b7e5-c0944eb130b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042694 Apr 14 11:01:41 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 294/880] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:41 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.758710 Apr 14 11:01:41 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 292/881] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:01:40 2023] POST /compute/v2.1/servers => generated 400 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:01:41 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-bb7e3cd4-14dd-4256-9ec8-3bb368675b80 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:41 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-bb7e3cd4-14dd-4256-9ec8-3bb368675b80 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:41 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-bb7e3cd4-14dd-4256-9ec8-3bb368675b80 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:01:41 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-bb7e3cd4-14dd-4256-9ec8-3bb368675b80 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813" status: 200 len: 1235 microversion: 2.1 time: 0.073679 Apr 14 11:01:41 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 296/882] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:01:41 2023] GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813 => generated 1235 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:01:43 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-32ff367f-0f58-43c4-88c0-48293e5d38ac req-eb224e72-df78-4490-bec5-b08c440d456d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba", "name": "network-vif-plugged", "status": "completed", "tag": "2b800e13-6dff-47b1-aced-1f9b2600868f"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-32ff367f-0f58-43c4-88c0-48293e5d38ac req-eb224e72-df78-4490-bec5-b08c440d456d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-32ff367f-0f58-43c4-88c0-48293e5d38ac req-eb224e72-df78-4490-bec5-b08c440d456d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-32ff367f-0f58-43c4-88c0-48293e5d38ac req-eb224e72-df78-4490-bec5-b08c440d456d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:43 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-32ff367f-0f58-43c4-88c0-48293e5d38ac req-eb224e72-df78-4490-bec5-b08c440d456d service nova] Creating event network-vif-plugged:2b800e13-6dff-47b1-aced-1f9b2600868f for instance a1fdcfb4-8700-48fe-9dec-1e8a4b766cba on user Apr 14 11:01:43 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-32ff367f-0f58-43c4-88c0-48293e5d38ac req-eb224e72-df78-4490-bec5-b08c440d456d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034059 Apr 14 11:01:43 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 295/883] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:45 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-1ce46fec-bbe0-4ff0-a553-687910707206 req-bb8afd83-53d2-4922-a7ff-85b77a158e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96e2a1a-8c1b-4189-86b9-a3c1761a9813", "tag": "7ee72a8e-db85-4e30-91e5-193e21c386cd"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:45 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1ce46fec-bbe0-4ff0-a553-687910707206 req-bb8afd83-53d2-4922-a7ff-85b77a158e3e service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:45 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1ce46fec-bbe0-4ff0-a553-687910707206 req-bb8afd83-53d2-4922-a7ff-85b77a158e3e service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:45 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-1ce46fec-bbe0-4ff0-a553-687910707206 req-bb8afd83-53d2-4922-a7ff-85b77a158e3e service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:45 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-1ce46fec-bbe0-4ff0-a553-687910707206 req-bb8afd83-53d2-4922-a7ff-85b77a158e3e service nova] Creating event network-changed:7ee72a8e-db85-4e30-91e5-193e21c386cd for instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 on user Apr 14 11:01:45 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-1ce46fec-bbe0-4ff0-a553-687910707206 req-bb8afd83-53d2-4922-a7ff-85b77a158e3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030600 Apr 14 11:01:45 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 293/884] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:45 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-c294fb21-2c9a-4924-9fee-8d8b6057eba0 req-fd721aab-e7b2-435c-9f04-a6fb4bfa3356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96e2a1a-8c1b-4189-86b9-a3c1761a9813", "name": "network-vif-plugged", "status": "completed", "tag": "7ee72a8e-db85-4e30-91e5-193e21c386cd"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-c294fb21-2c9a-4924-9fee-8d8b6057eba0 req-fd721aab-e7b2-435c-9f04-a6fb4bfa3356 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-c294fb21-2c9a-4924-9fee-8d8b6057eba0 req-fd721aab-e7b2-435c-9f04-a6fb4bfa3356 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:45 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-c294fb21-2c9a-4924-9fee-8d8b6057eba0 req-fd721aab-e7b2-435c-9f04-a6fb4bfa3356 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:45 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-c294fb21-2c9a-4924-9fee-8d8b6057eba0 req-fd721aab-e7b2-435c-9f04-a6fb4bfa3356 service nova] Creating event network-vif-plugged:7ee72a8e-db85-4e30-91e5-193e21c386cd for instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 on user Apr 14 11:01:45 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-c294fb21-2c9a-4924-9fee-8d8b6057eba0 req-fd721aab-e7b2-435c-9f04-a6fb4bfa3356 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034767 Apr 14 11:01:45 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 297/885] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:47 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:47 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=8 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:47 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-049ab204-3bd7-472e-9c5b-e29b9fb7bfe3 req-b3937287-7cd5-4b5b-b5ea-9a0d6322e72b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96e2a1a-8c1b-4189-86b9-a3c1761a9813", "name": "network-vif-plugged", "status": "completed", "tag": "7ee72a8e-db85-4e30-91e5-193e21c386cd"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:01:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-049ab204-3bd7-472e-9c5b-e29b9fb7bfe3 req-b3937287-7cd5-4b5b-b5ea-9a0d6322e72b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-049ab204-3bd7-472e-9c5b-e29b9fb7bfe3 req-b3937287-7cd5-4b5b-b5ea-9a0d6322e72b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-049ab204-3bd7-472e-9c5b-e29b9fb7bfe3 req-b3937287-7cd5-4b5b-b5ea-9a0d6322e72b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:47 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-049ab204-3bd7-472e-9c5b-e29b9fb7bfe3 req-b3937287-7cd5-4b5b-b5ea-9a0d6322e72b service nova] Creating event network-vif-plugged:7ee72a8e-db85-4e30-91e5-193e21c386cd for instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 on user Apr 14 11:01:47 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-049ab204-3bd7-472e-9c5b-e29b9fb7bfe3 req-b3937287-7cd5-4b5b-b5ea-9a0d6322e72b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036677 Apr 14 11:01:47 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 296/886] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:01:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:01:52 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:52 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=14 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:01:52 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-0a2ea4a9-f0be-4e58-8689-89b5cb4f2279 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:01:52 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-0a2ea4a9-f0be-4e58-8689-89b5cb4f2279 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:01:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0a2ea4a9-f0be-4e58-8689-89b5cb4f2279 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0a2ea4a9-f0be-4e58-8689-89b5cb4f2279 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0a2ea4a9-f0be-4e58-8689-89b5cb4f2279 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0a2ea4a9-f0be-4e58-8689-89b5cb4f2279 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:01:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0a2ea4a9-f0be-4e58-8689-89b5cb4f2279 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:01:52 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0a2ea4a9-f0be-4e58-8689-89b5cb4f2279 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:01:53 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-0a2ea4a9-f0be-4e58-8689-89b5cb4f2279 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:01:53 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-0a2ea4a9-f0be-4e58-8689-89b5cb4f2279 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e" status: 200 len: 1555 microversion: 2.1 time: 0.160752 Apr 14 11:01:53 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 294/887] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:01:52 2023] GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:02:06 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:06 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:06 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=18 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:06 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e5e78d7f-8ed1-43ca-8499-3143bc0f1cfe tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:02:06 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-e5e78d7f-8ed1-43ca-8499-3143bc0f1cfe tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:06 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e5e78d7f-8ed1-43ca-8499-3143bc0f1cfe tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:06 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e5e78d7f-8ed1-43ca-8499-3143bc0f1cfe tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:06 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e5e78d7f-8ed1-43ca-8499-3143bc0f1cfe tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:06 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e5e78d7f-8ed1-43ca-8499-3143bc0f1cfe tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:06 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e5e78d7f-8ed1-43ca-8499-3143bc0f1cfe tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:06 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e5e78d7f-8ed1-43ca-8499-3143bc0f1cfe tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:06 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-e5e78d7f-8ed1-43ca-8499-3143bc0f1cfe tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] HTTP exception thrown: Instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 could not be found. Apr 14 11:02:06 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e5e78d7f-8ed1-43ca-8499-3143bc0f1cfe tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Request method failure captured: Apr 14 11:02:06 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656 HTTP/1.1 Apr 14 11:02:06 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:02:06 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:02:06 user devstack@n-api.service[61841]: Connection: close Apr 14 11:02:06 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:02:06 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:02:06 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:02:06 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:02:06 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:02:06 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOTEIgOj0NgmYcxEiGzxHfN4vw48545mcfEfGNx5AesWscMRaA7B-lPsrNygwKAlTMjjbvXWHLiTFeTOBKhslGuOfWeA0U1spIMBl7YL9ZaRGavKZRpn2sjE_5mwbeB3t6cXB74ty1KTC-CHdm9QadC5765MQ-29IrGPhhc7uJY9rQJE Apr 14 11:02:06 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:02:06 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:02:06 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:02:06 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:02:06 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:02:06 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:02:06 user devstack@n-api.service[61841]: X-Project-Id: f629ba0ab8074ed8bb4e59d545b74eb6 Apr 14 11:02:06 user devstack@n-api.service[61841]: X-Project-Name: tempest-TestStampPattern-1000870021 Apr 14 11:02:06 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:02:06 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:02:06 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f629ba0ab8074ed8bb4e59d545b74eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f629ba0ab8074ed8bb4e59d545b74eb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f629ba0ab8074ed8bb4e59d545b74eb6"}]}] Apr 14 11:02:06 user devstack@n-api.service[61841]: X-Tenant: tempest-TestStampPattern-1000870021 Apr 14 11:02:06 user devstack@n-api.service[61841]: X-Tenant-Id: f629ba0ab8074ed8bb4e59d545b74eb6 Apr 14 11:02:06 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-TestStampPattern-1000870021 Apr 14 11:02:06 user devstack@n-api.service[61841]: X-User: tempest-TestStampPattern-1000870021-project-member Apr 14 11:02:06 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:02:06 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:02:06 user devstack@n-api.service[61841]: X-User-Id: e3ad6531a67b4be58a195e1208157b0b Apr 14 11:02:06 user devstack@n-api.service[61841]: X-User-Name: tempest-TestStampPattern-1000870021-project-member Apr 14 11:02:06 user devstack@n-api.service[61841]: method: > Apr 14 11:02:06 user devstack@n-api.service[61841]: exception: Instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 could not be found. Apr 14 11:02:06 user devstack@n-api.service[61841]: action_args: {'id': '3d6a53c3-6e32-456c-a056-fbf1bef3b656'} Apr 14 11:02:06 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 could not be found. Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 could not be found. Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 could not be found. Apr 14 11:02:06 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:02:06 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e5e78d7f-8ed1-43ca-8499-3143bc0f1cfe tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Returning 404 to user: Instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:02:06 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-e5e78d7f-8ed1-43ca-8499-3143bc0f1cfe tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656" status: 404 len: 111 microversion: 2.1 time: 0.036944 Apr 14 11:02:06 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 298/888] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:02:06 2023] GET /compute/v2.1/servers/3d6a53c3-6e32-456c-a056-fbf1bef3b656 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:02:13 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:13 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=18 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:13 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-e24c68ae-4aa5-4a9e-87ed-ae9f681b77e1 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:02:13 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-e24c68ae-4aa5-4a9e-87ed-ae9f681b77e1 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e24c68ae-4aa5-4a9e-87ed-ae9f681b77e1 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e24c68ae-4aa5-4a9e-87ed-ae9f681b77e1 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e24c68ae-4aa5-4a9e-87ed-ae9f681b77e1 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e24c68ae-4aa5-4a9e-87ed-ae9f681b77e1 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e24c68ae-4aa5-4a9e-87ed-ae9f681b77e1 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:13 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-e24c68ae-4aa5-4a9e-87ed-ae9f681b77e1 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:13 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-e24c68ae-4aa5-4a9e-87ed-ae9f681b77e1 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] HTTP exception thrown: Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe is not attached to volume f488d00e-998a-40d7-9e77-1bca2436fd95 Apr 14 11:02:13 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-e24c68ae-4aa5-4a9e-87ed-ae9f681b77e1 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Request method failure captured: Apr 14 11:02:13 user devstack@n-api.service[61840]: request: DELETE /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe/os-volume_attachments/f488d00e-998a-40d7-9e77-1bca2436fd95 HTTP/1.1 Apr 14 11:02:13 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:02:13 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:02:13 user devstack@n-api.service[61840]: Connection: close Apr 14 11:02:13 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:02:13 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:02:13 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:02:13 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:02:13 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:02:13 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTEIgOj0NgmYcxEiGzxHfN4vw48545mcfEfGNx5AesWscMRaA7B-lPsrNygwKAlTMjjbvXWHLiTFeTOBKhslGuOfWeA0U1spIMBl7YL9ZaRGavKZRpn2sjE_5mwbeB3t6cXB74ty1KTC-CHdm9QadC5765MQ-29IrGPhhc7uJY9rQJE Apr 14 11:02:13 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:02:13 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:02:13 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:02:13 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:02:13 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:02:13 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:02:13 user devstack@n-api.service[61840]: X-Project-Id: f629ba0ab8074ed8bb4e59d545b74eb6 Apr 14 11:02:13 user devstack@n-api.service[61840]: X-Project-Name: tempest-TestStampPattern-1000870021 Apr 14 11:02:13 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:02:13 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:02:13 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f629ba0ab8074ed8bb4e59d545b74eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f629ba0ab8074ed8bb4e59d545b74eb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f629ba0ab8074ed8bb4e59d545b74eb6"}]}] Apr 14 11:02:13 user devstack@n-api.service[61840]: X-Tenant: tempest-TestStampPattern-1000870021 Apr 14 11:02:13 user devstack@n-api.service[61840]: X-Tenant-Id: f629ba0ab8074ed8bb4e59d545b74eb6 Apr 14 11:02:13 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-TestStampPattern-1000870021 Apr 14 11:02:13 user devstack@n-api.service[61840]: X-User: tempest-TestStampPattern-1000870021-project-member Apr 14 11:02:13 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:02:13 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:02:13 user devstack@n-api.service[61840]: X-User-Id: e3ad6531a67b4be58a195e1208157b0b Apr 14 11:02:13 user devstack@n-api.service[61840]: X-User-Name: tempest-TestStampPattern-1000870021-project-member Apr 14 11:02:13 user devstack@n-api.service[61840]: method: > Apr 14 11:02:13 user devstack@n-api.service[61840]: exception: Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe is not attached to volume f488d00e-998a-40d7-9e77-1bca2436fd95 Apr 14 11:02:13 user devstack@n-api.service[61840]: action_args: {'server_id': 'e6580716-8a6a-4dfa-8978-ed54b92af1fe', 'id': 'f488d00e-998a-40d7-9e77-1bca2436fd95'} Apr 14 11:02:13 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f488d00e-998a-40d7-9e77-1bca2436fd95. Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe is not attached to volume f488d00e-998a-40d7-9e77-1bca2436fd95 Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe is not attached to volume f488d00e-998a-40d7-9e77-1bca2436fd95 Apr 14 11:02:13 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:02:13 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-e24c68ae-4aa5-4a9e-87ed-ae9f681b77e1 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Returning 404 to user: Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe is not attached to volume f488d00e-998a-40d7-9e77-1bca2436fd95 {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:02:13 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-e24c68ae-4aa5-4a9e-87ed-ae9f681b77e1 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe/os-volume_attachments/f488d00e-998a-40d7-9e77-1bca2436fd95" status: 404 len: 154 microversion: 2.1 time: 0.098665 Apr 14 11:02:13 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 297/889] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 11:02:13 2023] DELETE /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe/os-volume_attachments/f488d00e-998a-40d7-9e77-1bca2436fd95 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:02:13 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:02:13 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:13 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:13 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=14 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:13 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-ae04dc9a-edb8-4b86-b915-04f5c9921783 req-d8934007-d323-45c3-b9cc-9f3122f6528c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6580716-8a6a-4dfa-8978-ed54b92af1fe", "tag": "3019f976-f679-4826-8510-3de34b67807c"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:02:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:13 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ae04dc9a-edb8-4b86-b915-04f5c9921783 req-d8934007-d323-45c3-b9cc-9f3122f6528c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ae04dc9a-edb8-4b86-b915-04f5c9921783 req-d8934007-d323-45c3-b9cc-9f3122f6528c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-ae04dc9a-edb8-4b86-b915-04f5c9921783 req-d8934007-d323-45c3-b9cc-9f3122f6528c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:13 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-ae04dc9a-edb8-4b86-b915-04f5c9921783 req-d8934007-d323-45c3-b9cc-9f3122f6528c service nova] Creating event network-changed:3019f976-f679-4826-8510-3de34b67807c for instance e6580716-8a6a-4dfa-8978-ed54b92af1fe on user Apr 14 11:02:13 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-ae04dc9a-edb8-4b86-b915-04f5c9921783 req-d8934007-d323-45c3-b9cc-9f3122f6528c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039817 Apr 14 11:02:13 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 299/890] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:02:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:02:13 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:02:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe" status: 204 len: 0 microversion: 2.1 time: 0.127161 Apr 14 11:02:14 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 295/891] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:02:13 2023] DELETE /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:02:14 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-685acd17-3127-4fd8-a883-e0d907eb50d0 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:02:14 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-685acd17-3127-4fd8-a883-e0d907eb50d0 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-685acd17-3127-4fd8-a883-e0d907eb50d0 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-685acd17-3127-4fd8-a883-e0d907eb50d0 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-685acd17-3127-4fd8-a883-e0d907eb50d0 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-685acd17-3127-4fd8-a883-e0d907eb50d0 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-685acd17-3127-4fd8-a883-e0d907eb50d0 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-685acd17-3127-4fd8-a883-e0d907eb50d0 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:14 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-685acd17-3127-4fd8-a883-e0d907eb50d0 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3ad6531a67b4be58a195e1208157b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629ba0ab8074ed8bb4e59d545b74eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:02:14 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-685acd17-3127-4fd8-a883-e0d907eb50d0 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe" status: 200 len: 1662 microversion: 2.1 time: 0.245530 Apr 14 11:02:14 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 298/892] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:02:14 2023] GET /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe => generated 1662 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:02:14 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-fe7e736d-9e3b-402e-b763-34e77c975301 req-ffc1131e-351b-49e0-994f-e883e518fa6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6580716-8a6a-4dfa-8978-ed54b92af1fe", "name": "network-vif-unplugged", "status": "completed", "tag": "3019f976-f679-4826-8510-3de34b67807c"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:02:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-fe7e736d-9e3b-402e-b763-34e77c975301 req-ffc1131e-351b-49e0-994f-e883e518fa6f service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-fe7e736d-9e3b-402e-b763-34e77c975301 req-ffc1131e-351b-49e0-994f-e883e518fa6f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-fe7e736d-9e3b-402e-b763-34e77c975301 req-ffc1131e-351b-49e0-994f-e883e518fa6f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:14 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-fe7e736d-9e3b-402e-b763-34e77c975301 req-ffc1131e-351b-49e0-994f-e883e518fa6f service nova] Creating event network-vif-unplugged:3019f976-f679-4826-8510-3de34b67807c for instance e6580716-8a6a-4dfa-8978-ed54b92af1fe on user Apr 14 11:02:14 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-fe7e736d-9e3b-402e-b763-34e77c975301 req-ffc1131e-351b-49e0-994f-e883e518fa6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030839 Apr 14 11:02:14 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 300/893] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:02:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:02:15 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-44f50dd4-216a-4f0c-85d5-dbc0bc05efe5 req-cca45edf-5e8f-4658-a320-a27ffe8a0973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6580716-8a6a-4dfa-8978-ed54b92af1fe", "name": "network-vif-deleted", "tag": "3019f976-f679-4826-8510-3de34b67807c"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:02:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-44f50dd4-216a-4f0c-85d5-dbc0bc05efe5 req-cca45edf-5e8f-4658-a320-a27ffe8a0973 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-44f50dd4-216a-4f0c-85d5-dbc0bc05efe5 req-cca45edf-5e8f-4658-a320-a27ffe8a0973 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:15 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-44f50dd4-216a-4f0c-85d5-dbc0bc05efe5 req-cca45edf-5e8f-4658-a320-a27ffe8a0973 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:15 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-44f50dd4-216a-4f0c-85d5-dbc0bc05efe5 req-cca45edf-5e8f-4658-a320-a27ffe8a0973 service nova] Creating event network-vif-deleted:3019f976-f679-4826-8510-3de34b67807c for instance e6580716-8a6a-4dfa-8978-ed54b92af1fe on user Apr 14 11:02:15 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-44f50dd4-216a-4f0c-85d5-dbc0bc05efe5 req-cca45edf-5e8f-4658-a320-a27ffe8a0973 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028997 Apr 14 11:02:15 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 296/894] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:02:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:02:16 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-00d0455a-18c9-4c68-a408-3cb1765e26aa req-7a409dd4-8ba6-4e77-ab77-e9aec87d2581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6580716-8a6a-4dfa-8978-ed54b92af1fe", "name": "network-vif-plugged", "status": "completed", "tag": "3019f976-f679-4826-8510-3de34b67807c"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:02:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-00d0455a-18c9-4c68-a408-3cb1765e26aa req-7a409dd4-8ba6-4e77-ab77-e9aec87d2581 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-00d0455a-18c9-4c68-a408-3cb1765e26aa req-7a409dd4-8ba6-4e77-ab77-e9aec87d2581 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-00d0455a-18c9-4c68-a408-3cb1765e26aa req-7a409dd4-8ba6-4e77-ab77-e9aec87d2581 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-00d0455a-18c9-4c68-a408-3cb1765e26aa req-7a409dd4-8ba6-4e77-ab77-e9aec87d2581 service nova] Creating event network-vif-plugged:3019f976-f679-4826-8510-3de34b67807c for instance e6580716-8a6a-4dfa-8978-ed54b92af1fe on user Apr 14 11:02:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-00d0455a-18c9-4c68-a408-3cb1765e26aa req-7a409dd4-8ba6-4e77-ab77-e9aec87d2581 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032544 Apr 14 11:02:16 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 299/895] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:02:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:02:19 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-0fcdb979-b7c7-4aa9-82ed-e3b623a41479 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:02:19 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-0fcdb979-b7c7-4aa9-82ed-e3b623a41479 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0fcdb979-b7c7-4aa9-82ed-e3b623a41479 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0fcdb979-b7c7-4aa9-82ed-e3b623a41479 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0fcdb979-b7c7-4aa9-82ed-e3b623a41479 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0fcdb979-b7c7-4aa9-82ed-e3b623a41479 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0fcdb979-b7c7-4aa9-82ed-e3b623a41479 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:19 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0fcdb979-b7c7-4aa9-82ed-e3b623a41479 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:20 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-0fcdb979-b7c7-4aa9-82ed-e3b623a41479 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282af802879e463ea87844b5fc926692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310da753ca94b38a7c660b8613af044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:02:20 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-0fcdb979-b7c7-4aa9-82ed-e3b623a41479 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d70b388-155f-4e47-8352-b69c856b2000" status: 200 len: 1484 microversion: 2.1 time: 0.165378 Apr 14 11:02:20 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 301/896] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:02:19 2023] GET /compute/v2.1/servers/3d70b388-155f-4e47-8352-b69c856b2000 => generated 1484 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:02:25 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-7ca067ef-b86f-4bb0-a877-80c9fe550468 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:02:25 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-7ca067ef-b86f-4bb0-a877-80c9fe550468 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7ca067ef-b86f-4bb0-a877-80c9fe550468 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7ca067ef-b86f-4bb0-a877-80c9fe550468 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7ca067ef-b86f-4bb0-a877-80c9fe550468 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7ca067ef-b86f-4bb0-a877-80c9fe550468 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7ca067ef-b86f-4bb0-a877-80c9fe550468 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:25 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-7ca067ef-b86f-4bb0-a877-80c9fe550468 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:25 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-7ca067ef-b86f-4bb0-a877-80c9fe550468 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae4725537b4162b88b3eed27666bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '000980e0e886468b8df32c7373cde033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:02:25 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-7ca067ef-b86f-4bb0-a877-80c9fe550468 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" status: 200 len: 1485 microversion: 2.1 time: 0.153933 Apr 14 11:02:25 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 297/897] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:02:25 2023] GET /compute/v2.1/servers/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba => generated 1485 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:02:30 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:30 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=14 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:30 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:02:30 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:30 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:30 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177/action" status: 202 len: 0 microversion: 2.87 time: 0.086697 Apr 14 11:02:30 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 300/898] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 11:02:30 2023] POST /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:02:30 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-3c782397-fbfd-44c7-ab3e-ea9756f07676 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:02:30 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-3c782397-fbfd-44c7-ab3e-ea9756f07676 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:30 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=8 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:30 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=12 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3c782397-fbfd-44c7-ab3e-ea9756f07676 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3c782397-fbfd-44c7-ab3e-ea9756f07676 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3c782397-fbfd-44c7-ab3e-ea9756f07676 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3c782397-fbfd-44c7-ab3e-ea9756f07676 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3c782397-fbfd-44c7-ab3e-ea9756f07676 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:30 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3c782397-fbfd-44c7-ab3e-ea9756f07676 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:31 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-3c782397-fbfd-44c7-ab3e-ea9756f07676 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:02:31 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-3c782397-fbfd-44c7-ab3e-ea9756f07676 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:02:31 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-3c782397-fbfd-44c7-ab3e-ea9756f07676 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:02:31 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-3c782397-fbfd-44c7-ab3e-ea9756f07676 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177" status: 200 len: 1764 microversion: 2.87 time: 0.166492 Apr 14 11:02:31 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 302/899] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:02:30 2023] GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177 => generated 1764 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:02:31 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-48346e6c-d93f-4d97-9ad5-d5fc7206a3a1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:02:31 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-48346e6c-d93f-4d97-9ad5-d5fc7206a3a1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:31 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-48346e6c-d93f-4d97-9ad5-d5fc7206a3a1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:31 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-48346e6c-d93f-4d97-9ad5-d5fc7206a3a1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:31 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-48346e6c-d93f-4d97-9ad5-d5fc7206a3a1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:31 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-48346e6c-d93f-4d97-9ad5-d5fc7206a3a1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:31 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-48346e6c-d93f-4d97-9ad5-d5fc7206a3a1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:31 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-48346e6c-d93f-4d97-9ad5-d5fc7206a3a1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:31 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-48346e6c-d93f-4d97-9ad5-d5fc7206a3a1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:02:31 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-48346e6c-d93f-4d97-9ad5-d5fc7206a3a1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813" status: 200 len: 1545 microversion: 2.1 time: 0.230253 Apr 14 11:02:31 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 298/900] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:02:31 2023] GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813 => generated 1545 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:02:31 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-1feaa569-8a03-4914-aa59-a9a40bf814b6 req-69648042-c30f-4988-bf77-0974ce2f6093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcca78c-fe73-4ef1-92f9-4c8061cad177", "name": "network-vif-unplugged", "status": "completed", "tag": "845cc40f-1b03-4b85-8d19-fea731fe7f89"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:02:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-1feaa569-8a03-4914-aa59-a9a40bf814b6 req-69648042-c30f-4988-bf77-0974ce2f6093 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-1feaa569-8a03-4914-aa59-a9a40bf814b6 req-69648042-c30f-4988-bf77-0974ce2f6093 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-1feaa569-8a03-4914-aa59-a9a40bf814b6 req-69648042-c30f-4988-bf77-0974ce2f6093 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:31 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-1feaa569-8a03-4914-aa59-a9a40bf814b6 req-69648042-c30f-4988-bf77-0974ce2f6093 service nova] Creating event network-vif-unplugged:845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 on user Apr 14 11:02:31 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-1feaa569-8a03-4914-aa59-a9a40bf814b6 req-69648042-c30f-4988-bf77-0974ce2f6093 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036069 Apr 14 11:02:31 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 301/901] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:02:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:02:33 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-a14a4a1c-e813-4f7d-bb09-4048e8bb0d1c req-c18d5acc-84ca-421f-8444-c82640e5aeeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcca78c-fe73-4ef1-92f9-4c8061cad177", "name": "network-vif-plugged", "status": "completed", "tag": "845cc40f-1b03-4b85-8d19-fea731fe7f89"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:02:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-a14a4a1c-e813-4f7d-bb09-4048e8bb0d1c req-c18d5acc-84ca-421f-8444-c82640e5aeeb service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-a14a4a1c-e813-4f7d-bb09-4048e8bb0d1c req-c18d5acc-84ca-421f-8444-c82640e5aeeb service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-a14a4a1c-e813-4f7d-bb09-4048e8bb0d1c req-c18d5acc-84ca-421f-8444-c82640e5aeeb service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:33 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-a14a4a1c-e813-4f7d-bb09-4048e8bb0d1c req-c18d5acc-84ca-421f-8444-c82640e5aeeb service nova] Creating event network-vif-plugged:845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 on user Apr 14 11:02:33 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-a14a4a1c-e813-4f7d-bb09-4048e8bb0d1c req-c18d5acc-84ca-421f-8444-c82640e5aeeb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047047 Apr 14 11:02:33 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 303/902] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:02:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:02:35 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcca78c-fe73-4ef1-92f9-4c8061cad177", "name": "network-vif-plugged", "status": "completed", "tag": "845cc40f-1b03-4b85-8d19-fea731fe7f89"}, {"server_uuid": "fbcca78c-fe73-4ef1-92f9-4c8061cad177", "name": "network-vif-plugged", "status": "completed", "tag": "845cc40f-1b03-4b85-8d19-fea731fe7f89"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:02:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:35 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] Creating event network-vif-plugged:845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 on user Apr 14 11:02:35 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] Creating event network-vif-plugged:845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 on user Apr 14 11:02:35 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040313 Apr 14 11:02:35 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 299/903] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:02:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:02:41 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d4b09a50-4b06-48c9-bb27-a1efd520a093 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:02:41 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-d4b09a50-4b06-48c9-bb27-a1efd520a093 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d4b09a50-4b06-48c9-bb27-a1efd520a093 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d4b09a50-4b06-48c9-bb27-a1efd520a093 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d4b09a50-4b06-48c9-bb27-a1efd520a093 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d4b09a50-4b06-48c9-bb27-a1efd520a093 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d4b09a50-4b06-48c9-bb27-a1efd520a093 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d4b09a50-4b06-48c9-bb27-a1efd520a093 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:41 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-d4b09a50-4b06-48c9-bb27-a1efd520a093 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:02:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d4b09a50-4b06-48c9-bb27-a1efd520a093 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" status: 200 len: 1535 microversion: 2.1 time: 0.164820 Apr 14 11:02:41 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 302/904] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:02:41 2023] GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => generated 1535 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:02:41 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-092c07b0-640e-4443-9fdc-1e82764c252e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:02:41 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-092c07b0-640e-4443-9fdc-1e82764c252e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:02:41 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-092c07b0-640e-4443-9fdc-1e82764c252e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Searching by: {'deleted': False, 'project_id': '5809862340a84c83a772c65c77513608'} {{(pid=61841) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 11:02:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-092c07b0-640e-4443-9fdc-1e82764c252e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-092c07b0-640e-4443-9fdc-1e82764c252e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-092c07b0-640e-4443-9fdc-1e82764c252e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-092c07b0-640e-4443-9fdc-1e82764c252e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-092c07b0-640e-4443-9fdc-1e82764c252e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-092c07b0-640e-4443-9fdc-1e82764c252e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:41 user devstack@n-api.service[61841]: DEBUG nova.compute.multi_cell_list [None req-092c07b0-640e-4443-9fdc-1e82764c252e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61841) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 11:02:41 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-092c07b0-640e-4443-9fdc-1e82764c252e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.167195 Apr 14 11:02:41 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 304/905] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 11:02:41 2023] GET /compute/v2.1/servers => generated 340 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:02:41 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-5b29c339-944f-4267-89f0-3af063faad4f tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:02:41 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-5b29c339-944f-4267-89f0-3af063faad4f tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5b29c339-944f-4267-89f0-3af063faad4f tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5b29c339-944f-4267-89f0-3af063faad4f tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5b29c339-944f-4267-89f0-3af063faad4f tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5b29c339-944f-4267-89f0-3af063faad4f tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5b29c339-944f-4267-89f0-3af063faad4f tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5b29c339-944f-4267-89f0-3af063faad4f tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:41 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-5b29c339-944f-4267-89f0-3af063faad4f tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:02:41 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-5b29c339-944f-4267-89f0-3af063faad4f tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" status: 200 len: 1535 microversion: 2.1 time: 0.153072 Apr 14 11:02:41 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 300/906] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:02:41 2023] GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => generated 1535 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:02:43 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-fd06e24d-2680-4460-8be6-8235faf42550 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-340799528", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "048ec0ee-0465-448d-8b4c-f072acb101dc", "destination_type": "local"}, {"source_type": "volume", "uuid": "d0e93587-c07c-4830-a7fd-7907f0feabae", "destination_type": "invalid"}], "networks": [{"uuid": "0d829782-2ea4-4af3-8460-468b818423dc"}]}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:02:43 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-fd06e24d-2680-4460-8be6-8235faf42550 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Request method failure captured: Apr 14 11:02:43 user devstack@n-api.service[61840]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 11:02:43 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:02:43 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:02:43 user devstack@n-api.service[61840]: Connection: close Apr 14 11:02:43 user devstack@n-api.service[61840]: Content-Length: 493 Apr 14 11:02:43 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:02:43 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:02:43 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:02:43 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:02:43 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTEIFQshLfVvHk6zzMGyR_oC5LUKpIB3AE99vu24J4VUKIZ_I-EwK7Y3I7wnUHCRWCubyFlBrfn9xQqhiAoc3tpsRHBshn37If4FOH70hV1TDB1AZ7SkDOxW_ds35MJgoa5aV2nhuLsDoazuYmrCamSynjx9Vk7fjpVlXk7fFD9b_oc Apr 14 11:02:43 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:02:43 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:02:43 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:02:43 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:02:43 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:02:43 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:02:43 user devstack@n-api.service[61840]: X-Project-Id: be1c0764b8a843808158644eb90704e6 Apr 14 11:02:43 user devstack@n-api.service[61840]: X-Project-Name: tempest-ServersNegativeTestJSON-1472676568 Apr 14 11:02:43 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:02:43 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:02:43 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be1c0764b8a843808158644eb90704e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be1c0764b8a843808158644eb90704e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be1c0764b8a843808158644eb90704e6"}]}] Apr 14 11:02:43 user devstack@n-api.service[61840]: X-Tenant: tempest-ServersNegativeTestJSON-1472676568 Apr 14 11:02:43 user devstack@n-api.service[61840]: X-Tenant-Id: be1c0764b8a843808158644eb90704e6 Apr 14 11:02:43 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1472676568 Apr 14 11:02:43 user devstack@n-api.service[61840]: X-User: tempest-ServersNegativeTestJSON-1472676568-project-member Apr 14 11:02:43 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:02:43 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:02:43 user devstack@n-api.service[61840]: X-User-Id: b3f2157c5d4d441db80ea4a3ca60e4dc Apr 14 11:02:43 user devstack@n-api.service[61840]: X-User-Name: tempest-ServersNegativeTestJSON-1472676568-project-member Apr 14 11:02:43 user devstack@n-api.service[61840]: Apr 14 11:02:43 user devstack@n-api.service[61840]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-340799528", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "048ec0ee-0465-448d-8b4c-f072acb101dc", "destination_type": "local"}, {"source_type": "volume", "uuid": "d0e93587-c07c-4830-a7fd-7907f0feabae", "destination_type": "invalid"}], "networks": [{"uuid": "0d829782-2ea4-4af3-8460-468b818423dc"}]}} Apr 14 11:02:43 user devstack@n-api.service[61840]: method: > Apr 14 11:02:43 user devstack@n-api.service[61840]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 11:02:43 user devstack@n-api.service[61840]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-340799528', 'imageRef': '048ec0ee-0465-448d-8b4c-f072acb101dc', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '048ec0ee-0465-448d-8b4c-f072acb101dc', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'd0e93587-c07c-4830-a7fd-7907f0feabae', 'destination_type': 'invalid'}], 'networks': [{'uuid': '0d829782-2ea4-4af3-8460-468b818423dc'}]}}} Apr 14 11:02:43 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise error Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi 'invalid' Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 11:02:43 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:02:43 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-fd06e24d-2680-4460-8be6-8235faf42550 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:02:43 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-fd06e24d-2680-4460-8be6-8235faf42550 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.009334 Apr 14 11:02:43 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 303/907] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:02:43 2023] POST /compute/v2.1/servers => generated 155 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 11:02:43 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-cdb1c042-5416-44e5-bf17-f22cf6f282f2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:02:43 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-cdb1c042-5416-44e5-bf17-f22cf6f282f2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-cdb1c042-5416-44e5-bf17-f22cf6f282f2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-cdb1c042-5416-44e5-bf17-f22cf6f282f2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-cdb1c042-5416-44e5-bf17-f22cf6f282f2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-cdb1c042-5416-44e5-bf17-f22cf6f282f2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-cdb1c042-5416-44e5-bf17-f22cf6f282f2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-cdb1c042-5416-44e5-bf17-f22cf6f282f2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:43 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-cdb1c042-5416-44e5-bf17-f22cf6f282f2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f2157c5d4d441db80ea4a3ca60e4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1c0764b8a843808158644eb90704e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:02:43 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-cdb1c042-5416-44e5-bf17-f22cf6f282f2 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96" status: 200 len: 1495 microversion: 2.1 time: 0.252227 Apr 14 11:02:43 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 305/908] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:02:43 2023] GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96 => generated 1495 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:02:44 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0da1ed17-2b8c-4dd3-a61a-1133a9420d21"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:02:44 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:44 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:44 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:44 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320193 Apr 14 11:02:44 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 301/909] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 11:02:44 2023] POST /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:02:53 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:53 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:53 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:02:53 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e/action" status: 204 len: 0 microversion: 2.1 time: 0.074411 Apr 14 11:02:53 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 304/910] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 11:02:53 2023] POST /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:02:53 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-2c5dbf87-86a9-4497-a270-21373313c77b tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:02:53 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-2c5dbf87-86a9-4497-a270-21373313c77b tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:53 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2c5dbf87-86a9-4497-a270-21373313c77b tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2c5dbf87-86a9-4497-a270-21373313c77b tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2c5dbf87-86a9-4497-a270-21373313c77b tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2c5dbf87-86a9-4497-a270-21373313c77b tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2c5dbf87-86a9-4497-a270-21373313c77b tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2c5dbf87-86a9-4497-a270-21373313c77b tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:53 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-2c5dbf87-86a9-4497-a270-21373313c77b tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:02:53 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-2c5dbf87-86a9-4497-a270-21373313c77b tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e" status: 200 len: 1555 microversion: 2.1 time: 0.150912 Apr 14 11:02:53 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 306/911] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:02:53 2023] GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:02:55 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:55 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:02:55 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-3b85ab29-a3be-412d-84ce-0d148249967e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:02:55 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-3b85ab29-a3be-412d-84ce-0d148249967e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3b85ab29-a3be-412d-84ce-0d148249967e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3b85ab29-a3be-412d-84ce-0d148249967e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3b85ab29-a3be-412d-84ce-0d148249967e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3b85ab29-a3be-412d-84ce-0d148249967e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3b85ab29-a3be-412d-84ce-0d148249967e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3b85ab29-a3be-412d-84ce-0d148249967e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:55 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-3b85ab29-a3be-412d-84ce-0d148249967e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:02:55 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-3b85ab29-a3be-412d-84ce-0d148249967e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" status: 200 len: 1581 microversion: 2.1 time: 0.311578 Apr 14 11:02:55 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 302/912] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:02:55 2023] GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => generated 1581 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:02:57 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-4acaca7f-c7cc-4768-ac22-11f607820565 req-59a84ee1-4a56-44a3-9e1c-576161771b4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:02:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-4acaca7f-c7cc-4768-ac22-11f607820565 req-59a84ee1-4a56-44a3-9e1c-576161771b4a service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-4acaca7f-c7cc-4768-ac22-11f607820565 req-59a84ee1-4a56-44a3-9e1c-576161771b4a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-4acaca7f-c7cc-4768-ac22-11f607820565 req-59a84ee1-4a56-44a3-9e1c-576161771b4a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:57 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-4acaca7f-c7cc-4768-ac22-11f607820565 req-59a84ee1-4a56-44a3-9e1c-576161771b4a service nova] Creating event network-changed:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:02:57 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-4acaca7f-c7cc-4768-ac22-11f607820565 req-59a84ee1-4a56-44a3-9e1c-576161771b4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031478 Apr 14 11:02:57 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 305/913] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:02:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:02:58 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-6eca7ba9-f3c8-4029-aa48-a7a8a1b6c69b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-645258552"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:02:58 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-6eca7ba9-f3c8-4029-aa48-a7a8a1b6c69b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6eca7ba9-f3c8-4029-aa48-a7a8a1b6c69b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6eca7ba9-f3c8-4029-aa48-a7a8a1b6c69b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6eca7ba9-f3c8-4029-aa48-a7a8a1b6c69b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6eca7ba9-f3c8-4029-aa48-a7a8a1b6c69b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6eca7ba9-f3c8-4029-aa48-a7a8a1b6c69b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6eca7ba9-f3c8-4029-aa48-a7a8a1b6c69b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:59 user devstack@n-api.service[61841]: INFO nova.network.security_group_api [None req-6eca7ba9-f3c8-4029-aa48-a7a8a1b6c69b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Adding security group fa72c410-b997-4799-99e3-2bf5b3e1d7ca to port f41f6957-bf6d-47bf-bb71-638137929e1e Apr 14 11:02:59 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-6eca7ba9-f3c8-4029-aa48-a7a8a1b6c69b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/action" status: 202 len: 0 microversion: 2.1 time: 1.152653 Apr 14 11:02:59 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 307/914] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 11:02:58 2023] POST /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/action => generated 0 bytes in 1154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:02:59 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-43a6c57a-68b5-4a33-9eb9-a08a29f3c01b req-97166d0a-bf14-4e69-9115-e0d2431dc18b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:02:59 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-07cfbd51-1407-4d22-b3fe-ebc40db699df tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:02:59 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-07cfbd51-1407-4d22-b3fe-ebc40db699df tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:02:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-07cfbd51-1407-4d22-b3fe-ebc40db699df tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-07cfbd51-1407-4d22-b3fe-ebc40db699df tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-07cfbd51-1407-4d22-b3fe-ebc40db699df tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-43a6c57a-68b5-4a33-9eb9-a08a29f3c01b req-97166d0a-bf14-4e69-9115-e0d2431dc18b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-07cfbd51-1407-4d22-b3fe-ebc40db699df tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:02:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-43a6c57a-68b5-4a33-9eb9-a08a29f3c01b req-97166d0a-bf14-4e69-9115-e0d2431dc18b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-43a6c57a-68b5-4a33-9eb9-a08a29f3c01b req-97166d0a-bf14-4e69-9115-e0d2431dc18b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-07cfbd51-1407-4d22-b3fe-ebc40db699df tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:02:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-07cfbd51-1407-4d22-b3fe-ebc40db699df tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:02:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-43a6c57a-68b5-4a33-9eb9-a08a29f3c01b req-97166d0a-bf14-4e69-9115-e0d2431dc18b service nova] Creating event network-changed:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:03:00 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-43a6c57a-68b5-4a33-9eb9-a08a29f3c01b req-97166d0a-bf14-4e69-9115-e0d2431dc18b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037777 Apr 14 11:03:00 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 303/915] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:02:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:00 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-07cfbd51-1407-4d22-b3fe-ebc40db699df tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:03:00 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-07cfbd51-1407-4d22-b3fe-ebc40db699df tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" status: 200 len: 1746 microversion: 2.1 time: 0.534659 Apr 14 11:03:00 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 306/916] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:02:59 2023] GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => generated 1746 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:03:03 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:03:03 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:03 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=15 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:03:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:03 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=33 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:03:03 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/action" status: 202 len: 0 microversion: 2.1 time: 0.085104 Apr 14 11:03:03 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 308/917] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 11:03:03 2023] POST /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:03:03 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-644328b8-c3de-4433-9b6c-d5a4fc0aff8b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:03 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-644328b8-c3de-4433-9b6c-d5a4fc0aff8b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-644328b8-c3de-4433-9b6c-d5a4fc0aff8b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-644328b8-c3de-4433-9b6c-d5a4fc0aff8b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-644328b8-c3de-4433-9b6c-d5a4fc0aff8b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-644328b8-c3de-4433-9b6c-d5a4fc0aff8b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-644328b8-c3de-4433-9b6c-d5a4fc0aff8b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-644328b8-c3de-4433-9b6c-d5a4fc0aff8b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:04 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-644328b8-c3de-4433-9b6c-d5a4fc0aff8b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:03:04 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-644328b8-c3de-4433-9b6c-d5a4fc0aff8b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" status: 200 len: 1748 microversion: 2.1 time: 0.156137 Apr 14 11:03:04 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 304/918] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:03:03 2023] GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:03:04 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-210fbedb-06ae-4bb4-8ed2-b4911d6ec7bc tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:04 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-210fbedb-06ae-4bb4-8ed2-b4911d6ec7bc tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-210fbedb-06ae-4bb4-8ed2-b4911d6ec7bc tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-210fbedb-06ae-4bb4-8ed2-b4911d6ec7bc tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-210fbedb-06ae-4bb4-8ed2-b4911d6ec7bc tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-210fbedb-06ae-4bb4-8ed2-b4911d6ec7bc tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-210fbedb-06ae-4bb4-8ed2-b4911d6ec7bc tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:04 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-210fbedb-06ae-4bb4-8ed2-b4911d6ec7bc tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:04 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-210fbedb-06ae-4bb4-8ed2-b4911d6ec7bc tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] HTTP exception thrown: Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe could not be found. Apr 14 11:03:04 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-210fbedb-06ae-4bb4-8ed2-b4911d6ec7bc tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Request method failure captured: Apr 14 11:03:04 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe HTTP/1.1 Apr 14 11:03:04 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:03:04 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:03:04 user devstack@n-api.service[61840]: Connection: close Apr 14 11:03:04 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:03:04 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:03:04 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:03:04 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:03:04 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:03:04 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTEIgOj0NgmYcxEiGzxHfN4vw48545mcfEfGNx5AesWscMRaA7B-lPsrNygwKAlTMjjbvXWHLiTFeTOBKhslGuOfWeA0U1spIMBl7YL9ZaRGavKZRpn2sjE_5mwbeB3t6cXB74ty1KTC-CHdm9QadC5765MQ-29IrGPhhc7uJY9rQJE Apr 14 11:03:04 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:03:04 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:03:04 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:03:04 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:03:04 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:03:04 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:03:04 user devstack@n-api.service[61840]: X-Project-Id: f629ba0ab8074ed8bb4e59d545b74eb6 Apr 14 11:03:04 user devstack@n-api.service[61840]: X-Project-Name: tempest-TestStampPattern-1000870021 Apr 14 11:03:04 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:03:04 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:03:04 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f629ba0ab8074ed8bb4e59d545b74eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f629ba0ab8074ed8bb4e59d545b74eb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f629ba0ab8074ed8bb4e59d545b74eb6"}]}] Apr 14 11:03:04 user devstack@n-api.service[61840]: X-Tenant: tempest-TestStampPattern-1000870021 Apr 14 11:03:04 user devstack@n-api.service[61840]: X-Tenant-Id: f629ba0ab8074ed8bb4e59d545b74eb6 Apr 14 11:03:04 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-TestStampPattern-1000870021 Apr 14 11:03:04 user devstack@n-api.service[61840]: X-User: tempest-TestStampPattern-1000870021-project-member Apr 14 11:03:04 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:03:04 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:03:04 user devstack@n-api.service[61840]: X-User-Id: e3ad6531a67b4be58a195e1208157b0b Apr 14 11:03:04 user devstack@n-api.service[61840]: X-User-Name: tempest-TestStampPattern-1000870021-project-member Apr 14 11:03:04 user devstack@n-api.service[61840]: method: > Apr 14 11:03:04 user devstack@n-api.service[61840]: exception: Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe could not be found. Apr 14 11:03:04 user devstack@n-api.service[61840]: action_args: {'id': 'e6580716-8a6a-4dfa-8978-ed54b92af1fe'} Apr 14 11:03:04 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe could not be found. Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe could not be found. Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe could not be found. Apr 14 11:03:04 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:03:04 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-210fbedb-06ae-4bb4-8ed2-b4911d6ec7bc tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Returning 404 to user: Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:03:04 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-210fbedb-06ae-4bb4-8ed2-b4911d6ec7bc tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe" status: 404 len: 111 microversion: 2.1 time: 0.033031 Apr 14 11:03:04 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 307/919] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:03:04 2023] GET /compute/v2.1/servers/e6580716-8a6a-4dfa-8978-ed54b92af1fe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:03:05 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-5748080e-452d-4491-a2b5-df06ab9626ab req-36ef39fa-4cd8-41dc-96f2-1889ca0e4ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "name": "network-vif-unplugged", "status": "completed", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:03:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5748080e-452d-4491-a2b5-df06ab9626ab req-36ef39fa-4cd8-41dc-96f2-1889ca0e4ae0 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5748080e-452d-4491-a2b5-df06ab9626ab req-36ef39fa-4cd8-41dc-96f2-1889ca0e4ae0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5748080e-452d-4491-a2b5-df06ab9626ab req-36ef39fa-4cd8-41dc-96f2-1889ca0e4ae0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-5748080e-452d-4491-a2b5-df06ab9626ab req-36ef39fa-4cd8-41dc-96f2-1889ca0e4ae0 service nova] Creating event network-vif-unplugged:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:03:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-5748080e-452d-4491-a2b5-df06ab9626ab req-36ef39fa-4cd8-41dc-96f2-1889ca0e4ae0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127431 Apr 14 11:03:05 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 309/920] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:03:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:07 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-8a8505ea-de38-44fb-a956-a500e7eb9102 req-4311be4c-e25a-4f66-bbd9-51f948a31af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "name": "network-vif-plugged", "status": "completed", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:03:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8a8505ea-de38-44fb-a956-a500e7eb9102 req-4311be4c-e25a-4f66-bbd9-51f948a31af7 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8a8505ea-de38-44fb-a956-a500e7eb9102 req-4311be4c-e25a-4f66-bbd9-51f948a31af7 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8a8505ea-de38-44fb-a956-a500e7eb9102 req-4311be4c-e25a-4f66-bbd9-51f948a31af7 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:07 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-8a8505ea-de38-44fb-a956-a500e7eb9102 req-4311be4c-e25a-4f66-bbd9-51f948a31af7 service nova] Creating event network-vif-plugged:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:03:07 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-8a8505ea-de38-44fb-a956-a500e7eb9102 req-4311be4c-e25a-4f66-bbd9-51f948a31af7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035075 Apr 14 11:03:07 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 305/921] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:03:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:07 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-fb2fc688-0b61-4e0a-81fb-3abfe28a64e2 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Calling method '.version_select at 0x7fcd1ce46560>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:07 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-fb2fc688-0b61-4e0a-81fb-3abfe28a64e2 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-627373922" status: 202 len: 0 microversion: 2.1 time: 0.030016 Apr 14 11:03:07 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 308/922] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 11:03:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-627373922 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:03:10 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-bef025aa-3338-4664-85fb-f3b04f73663b req-5e5399f4-5317-42ba-a3c1-8c29ab5c525b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "name": "network-vif-plugged", "status": "completed", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:03:10 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-bef025aa-3338-4664-85fb-f3b04f73663b req-5e5399f4-5317-42ba-a3c1-8c29ab5c525b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:10 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-bef025aa-3338-4664-85fb-f3b04f73663b req-5e5399f4-5317-42ba-a3c1-8c29ab5c525b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:10 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-bef025aa-3338-4664-85fb-f3b04f73663b req-5e5399f4-5317-42ba-a3c1-8c29ab5c525b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:10 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-bef025aa-3338-4664-85fb-f3b04f73663b req-5e5399f4-5317-42ba-a3c1-8c29ab5c525b service nova] Creating event network-vif-plugged:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:03:10 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-bef025aa-3338-4664-85fb-f3b04f73663b req-5e5399f4-5317-42ba-a3c1-8c29ab5c525b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042980 Apr 14 11:03:10 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 310/923] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:03:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:12 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-ef6bbefd-bead-4df8-baea-e1f22d18c4ea req-13a468c2-47c6-4230-a860-96fa6a14be04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "name": "network-vif-plugged", "status": "completed", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:03:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-ef6bbefd-bead-4df8-baea-e1f22d18c4ea req-13a468c2-47c6-4230-a860-96fa6a14be04 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-ef6bbefd-bead-4df8-baea-e1f22d18c4ea req-13a468c2-47c6-4230-a860-96fa6a14be04 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-ef6bbefd-bead-4df8-baea-e1f22d18c4ea req-13a468c2-47c6-4230-a860-96fa6a14be04 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:12 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-ef6bbefd-bead-4df8-baea-e1f22d18c4ea req-13a468c2-47c6-4230-a860-96fa6a14be04 service nova] Creating event network-vif-plugged:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:03:12 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-ef6bbefd-bead-4df8-baea-e1f22d18c4ea req-13a468c2-47c6-4230-a860-96fa6a14be04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029224 Apr 14 11:03:12 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 306/924] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:03:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:20 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:03:20 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:03:20 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:20 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:20 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:20 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Going to try to terminate instance {{(pid=61840) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:03:20 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d70b388-155f-4e47-8352-b69c856b2000" status: 204 len: 0 microversion: 2.1 time: 0.129713 Apr 14 11:03:20 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 309/925] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:03:20 2023] DELETE /compute/v2.1/servers/3d70b388-155f-4e47-8352-b69c856b2000 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:03:20 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=5 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:03:20 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:03:20 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-96b0cce8-a879-4147-a05a-6fd66fa00bee tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:20 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-96b0cce8-a879-4147-a05a-6fd66fa00bee tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-96b0cce8-a879-4147-a05a-6fd66fa00bee tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-96b0cce8-a879-4147-a05a-6fd66fa00bee tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-96b0cce8-a879-4147-a05a-6fd66fa00bee tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-96b0cce8-a879-4147-a05a-6fd66fa00bee tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-96b0cce8-a879-4147-a05a-6fd66fa00bee tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-96b0cce8-a879-4147-a05a-6fd66fa00bee tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-2ad758ff-7bb6-4283-9811-2dd215634946 req-23887c63-a4c0-4438-9b1c-ffc46df2c2d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d70b388-155f-4e47-8352-b69c856b2000", "name": "network-vif-unplugged", "status": "completed", "tag": "77c6475d-8834-422b-ab62-0bd935284c56"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:03:21 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-96b0cce8-a879-4147-a05a-6fd66fa00bee tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282af802879e463ea87844b5fc926692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310da753ca94b38a7c660b8613af044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:03:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2ad758ff-7bb6-4283-9811-2dd215634946 req-23887c63-a4c0-4438-9b1c-ffc46df2c2d2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2ad758ff-7bb6-4283-9811-2dd215634946 req-23887c63-a4c0-4438-9b1c-ffc46df2c2d2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-2ad758ff-7bb6-4283-9811-2dd215634946 req-23887c63-a4c0-4438-9b1c-ffc46df2c2d2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:21 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-96b0cce8-a879-4147-a05a-6fd66fa00bee tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d70b388-155f-4e47-8352-b69c856b2000" status: 200 len: 1490 microversion: 2.1 time: 0.272955 Apr 14 11:03:21 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 311/926] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:03:20 2023] GET /compute/v2.1/servers/3d70b388-155f-4e47-8352-b69c856b2000 => generated 1490 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:03:21 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-2ad758ff-7bb6-4283-9811-2dd215634946 req-23887c63-a4c0-4438-9b1c-ffc46df2c2d2 service nova] Creating event network-vif-unplugged:77c6475d-8834-422b-ab62-0bd935284c56 for instance 3d70b388-155f-4e47-8352-b69c856b2000 on user Apr 14 11:03:21 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-2ad758ff-7bb6-4283-9811-2dd215634946 req-23887c63-a4c0-4438-9b1c-ffc46df2c2d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033135 Apr 14 11:03:21 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 307/927] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:03:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:21 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-295d933c-596f-4270-b189-c1a7a3ea6606 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:21 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-295d933c-596f-4270-b189-c1a7a3ea6606 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-295d933c-596f-4270-b189-c1a7a3ea6606 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-295d933c-596f-4270-b189-c1a7a3ea6606 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-295d933c-596f-4270-b189-c1a7a3ea6606 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-295d933c-596f-4270-b189-c1a7a3ea6606 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-295d933c-596f-4270-b189-c1a7a3ea6606 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:21 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-295d933c-596f-4270-b189-c1a7a3ea6606 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:21 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-295d933c-596f-4270-b189-c1a7a3ea6606 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:03:21 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-295d933c-596f-4270-b189-c1a7a3ea6606 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:03:21 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-295d933c-596f-4270-b189-c1a7a3ea6606 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:03:21 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-295d933c-596f-4270-b189-c1a7a3ea6606 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177" status: 200 len: 1770 microversion: 2.87 time: 0.451287 Apr 14 11:03:21 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 310/928] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:03:21 2023] GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177 => generated 1770 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:03:22 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-e81e3f2f-d3be-4f65-a81c-18d091f83b92 req-fa168ae5-b59e-4f7a-a662-2dca66aabb10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d70b388-155f-4e47-8352-b69c856b2000", "name": "network-vif-deleted", "tag": "77c6475d-8834-422b-ab62-0bd935284c56"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:03:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e81e3f2f-d3be-4f65-a81c-18d091f83b92 req-fa168ae5-b59e-4f7a-a662-2dca66aabb10 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e81e3f2f-d3be-4f65-a81c-18d091f83b92 req-fa168ae5-b59e-4f7a-a662-2dca66aabb10 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:22 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e81e3f2f-d3be-4f65-a81c-18d091f83b92 req-fa168ae5-b59e-4f7a-a662-2dca66aabb10 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:22 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-e81e3f2f-d3be-4f65-a81c-18d091f83b92 req-fa168ae5-b59e-4f7a-a662-2dca66aabb10 service nova] Creating event network-vif-deleted:77c6475d-8834-422b-ab62-0bd935284c56 for instance 3d70b388-155f-4e47-8352-b69c856b2000 on user Apr 14 11:03:22 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-e81e3f2f-d3be-4f65-a81c-18d091f83b92 req-fa168ae5-b59e-4f7a-a662-2dca66aabb10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032124 Apr 14 11:03:22 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 312/929] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:03:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:23 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-f20663de-ca3c-4d5f-b45c-835ca0e9addd req-4151db4b-23be-47b1-9826-bf98c98e3c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d70b388-155f-4e47-8352-b69c856b2000", "name": "network-vif-plugged", "status": "completed", "tag": "77c6475d-8834-422b-ab62-0bd935284c56"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:03:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f20663de-ca3c-4d5f-b45c-835ca0e9addd req-4151db4b-23be-47b1-9826-bf98c98e3c5a service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f20663de-ca3c-4d5f-b45c-835ca0e9addd req-4151db4b-23be-47b1-9826-bf98c98e3c5a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f20663de-ca3c-4d5f-b45c-835ca0e9addd req-4151db4b-23be-47b1-9826-bf98c98e3c5a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:23 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-f20663de-ca3c-4d5f-b45c-835ca0e9addd req-4151db4b-23be-47b1-9826-bf98c98e3c5a service nova] Creating event network-vif-plugged:77c6475d-8834-422b-ab62-0bd935284c56 for instance 3d70b388-155f-4e47-8352-b69c856b2000 on user Apr 14 11:03:23 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-f20663de-ca3c-4d5f-b45c-835ca0e9addd req-4151db4b-23be-47b1-9826-bf98c98e3c5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043710 Apr 14 11:03:23 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 308/930] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:03:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:31 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-04376e58-ff81-464b-b9bf-2259cd0d43e0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:31 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-04376e58-ff81-464b-b9bf-2259cd0d43e0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-04376e58-ff81-464b-b9bf-2259cd0d43e0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-04376e58-ff81-464b-b9bf-2259cd0d43e0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-04376e58-ff81-464b-b9bf-2259cd0d43e0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-04376e58-ff81-464b-b9bf-2259cd0d43e0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-04376e58-ff81-464b-b9bf-2259cd0d43e0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:31 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-04376e58-ff81-464b-b9bf-2259cd0d43e0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:31 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-04376e58-ff81-464b-b9bf-2259cd0d43e0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.156907 Apr 14 11:03:31 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 311/931] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 11:03:31 2023] GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/os-interface => generated 282 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=8 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:03:32 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" status: 204 len: 0 microversion: 2.1 time: 0.182818 Apr 14 11:03:32 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 313/932] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:03:32 2023] DELETE /compute/v2.1/servers/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:03:32 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-bd5a4a9e-05f2-40f9-adee-c6eb3b9c6e2c tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:32 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-bd5a4a9e-05f2-40f9-adee-c6eb3b9c6e2c tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:32 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=15 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:03:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bd5a4a9e-05f2-40f9-adee-c6eb3b9c6e2c tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bd5a4a9e-05f2-40f9-adee-c6eb3b9c6e2c tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bd5a4a9e-05f2-40f9-adee-c6eb3b9c6e2c tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bd5a4a9e-05f2-40f9-adee-c6eb3b9c6e2c tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bd5a4a9e-05f2-40f9-adee-c6eb3b9c6e2c tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-bd5a4a9e-05f2-40f9-adee-c6eb3b9c6e2c tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:32 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=23 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:03:32 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-efe9e20c-5247-4cb0-8b3d-e11c13f955b9 req-9dd57b3f-6afa-4460-b07b-ed0e6fa44e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96e2a1a-8c1b-4189-86b9-a3c1761a9813", "tag": "7ee72a8e-db85-4e30-91e5-193e21c386cd"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:03:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-efe9e20c-5247-4cb0-8b3d-e11c13f955b9 req-9dd57b3f-6afa-4460-b07b-ed0e6fa44e27 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-efe9e20c-5247-4cb0-8b3d-e11c13f955b9 req-9dd57b3f-6afa-4460-b07b-ed0e6fa44e27 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-efe9e20c-5247-4cb0-8b3d-e11c13f955b9 req-9dd57b3f-6afa-4460-b07b-ed0e6fa44e27 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-efe9e20c-5247-4cb0-8b3d-e11c13f955b9 req-9dd57b3f-6afa-4460-b07b-ed0e6fa44e27 service nova] Creating event network-changed:7ee72a8e-db85-4e30-91e5-193e21c386cd for instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 on user Apr 14 11:03:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-efe9e20c-5247-4cb0-8b3d-e11c13f955b9 req-9dd57b3f-6afa-4460-b07b-ed0e6fa44e27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037974 Apr 14 11:03:32 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 312/933] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:03:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:32 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-bd5a4a9e-05f2-40f9-adee-c6eb3b9c6e2c tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ae4725537b4162b88b3eed27666bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '000980e0e886468b8df32c7373cde033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a6093df7-87e3-40d1-a04e-b8e20e44a7bc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:32 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-bd5a4a9e-05f2-40f9-adee-c6eb3b9c6e2c tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" status: 200 len: 1491 microversion: 2.1 time: 0.336782 Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-a6093df7-87e3-40d1-a04e-b8e20e44a7bc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:32 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 309/934] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:03:32 2023] GET /compute/v2.1/servers/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba => generated 1491 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a6093df7-87e3-40d1-a04e-b8e20e44a7bc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a6093df7-87e3-40d1-a04e-b8e20e44a7bc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a6093df7-87e3-40d1-a04e-b8e20e44a7bc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a6093df7-87e3-40d1-a04e-b8e20e44a7bc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a6093df7-87e3-40d1-a04e-b8e20e44a7bc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a6093df7-87e3-40d1-a04e-b8e20e44a7bc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:32 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a6093df7-87e3-40d1-a04e-b8e20e44a7bc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/ips" status: 200 len: 108 microversion: 2.1 time: 0.041482 Apr 14 11:03:32 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 314/935] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 11:03:32 2023] GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/ips => generated 108 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:34 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba", "name": "network-vif-unplugged", "status": "completed", "tag": "2b800e13-6dff-47b1-aced-1f9b2600868f"}, {"server_uuid": "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba", "name": "network-vif-plugged", "status": "completed", "tag": "2b800e13-6dff-47b1-aced-1f9b2600868f"}, {"server_uuid": "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba", "name": "network-vif-deleted", "tag": "2b800e13-6dff-47b1-aced-1f9b2600868f"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:03:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] Creating event network-vif-unplugged:2b800e13-6dff-47b1-aced-1f9b2600868f for instance a1fdcfb4-8700-48fe-9dec-1e8a4b766cba on user Apr 14 11:03:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] Creating event network-vif-plugged:2b800e13-6dff-47b1-aced-1f9b2600868f for instance a1fdcfb4-8700-48fe-9dec-1e8a4b766cba on user Apr 14 11:03:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] Creating event network-vif-deleted:2b800e13-6dff-47b1-aced-1f9b2600868f for instance a1fdcfb4-8700-48fe-9dec-1e8a4b766cba on user Apr 14 11:03:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.045946 Apr 14 11:03:34 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 313/936] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:03:34 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:35 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c15d29b-d395-4a8f-ae98-ef8d51aa6133"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:03:35 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:35 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533281 Apr 14 11:03:35 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 310/937] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 11:03:35 2023] POST /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/os-volume_attachments => generated 194 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:43 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-4d9e48ba-6149-48e8-9f95-cabd2441d4a3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:43 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-4d9e48ba-6149-48e8-9f95-cabd2441d4a3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:43 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:03:43 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:03:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4d9e48ba-6149-48e8-9f95-cabd2441d4a3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4d9e48ba-6149-48e8-9f95-cabd2441d4a3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4d9e48ba-6149-48e8-9f95-cabd2441d4a3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4d9e48ba-6149-48e8-9f95-cabd2441d4a3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4d9e48ba-6149-48e8-9f95-cabd2441d4a3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-4d9e48ba-6149-48e8-9f95-cabd2441d4a3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:43 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-4d9e48ba-6149-48e8-9f95-cabd2441d4a3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:03:43 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-4d9e48ba-6149-48e8-9f95-cabd2441d4a3 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e" status: 200 len: 1547 microversion: 2.1 time: 0.158408 Apr 14 11:03:43 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 315/938] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:03:43 2023] GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:03:43 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:43 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:43 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:43 user devstack@n-api.service[61840]: DEBUG nova.objects.instance [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'services' on Instance uuid b96e2a1a-8c1b-4189-86b9-a3c1761a9813 {{(pid=61840) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 11:03:43 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/os-volume_attachments/7c15d29b-d395-4a8f-ae98-ef8d51aa6133" status: 202 len: 0 microversion: 2.1 time: 0.217999 Apr 14 11:03:43 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 314/939] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 11:03:43 2023] DELETE /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/os-volume_attachments/7c15d29b-d395-4a8f-ae98-ef8d51aa6133 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:03:43 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-dc3d6e00-4721-4601-b0c6-752b66bb1d7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:43 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-dc3d6e00-4721-4601-b0c6-752b66bb1d7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dc3d6e00-4721-4601-b0c6-752b66bb1d7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dc3d6e00-4721-4601-b0c6-752b66bb1d7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dc3d6e00-4721-4601-b0c6-752b66bb1d7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dc3d6e00-4721-4601-b0c6-752b66bb1d7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dc3d6e00-4721-4601-b0c6-752b66bb1d7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-dc3d6e00-4721-4601-b0c6-752b66bb1d7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:43 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-dc3d6e00-4721-4601-b0c6-752b66bb1d7f tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060749 Apr 14 11:03:43 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 311/940] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:03:43 2023] GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-61512508-b241-48e1-a740-77d7f0b3dade tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-61512508-b241-48e1-a740-77d7f0b3dade tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-61512508-b241-48e1-a740-77d7f0b3dade tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-61512508-b241-48e1-a740-77d7f0b3dade tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-61512508-b241-48e1-a740-77d7f0b3dade tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-61512508-b241-48e1-a740-77d7f0b3dade tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-61512508-b241-48e1-a740-77d7f0b3dade tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-61512508-b241-48e1-a740-77d7f0b3dade tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-61512508-b241-48e1-a740-77d7f0b3dade tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] HTTP exception thrown: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-61512508-b241-48e1-a740-77d7f0b3dade tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Request method failure captured: Apr 14 11:03:50 user devstack@n-api.service[61841]: request: DELETE /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba HTTP/1.1 Apr 14 11:03:50 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:03:50 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:03:50 user devstack@n-api.service[61841]: Connection: close Apr 14 11:03:50 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:03:50 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:03:50 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:03:50 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:03:50 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:03:50 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOTEIFQshLfVvHk6zzMGyR_oC5LUKpIB3AE99vu24J4VUKIZ_I-EwK7Y3I7wnUHCRWCubyFlBrfn9xQqhiAoc3tpsRHBshn37If4FOH70hV1TDB1AZ7SkDOxW_ds35MJgoa5aV2nhuLsDoazuYmrCamSynjx9Vk7fjpVlXk7fFD9b_oc Apr 14 11:03:50 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:03:50 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:03:50 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:03:50 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:03:50 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:03:50 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:03:50 user devstack@n-api.service[61841]: X-Project-Id: be1c0764b8a843808158644eb90704e6 Apr 14 11:03:50 user devstack@n-api.service[61841]: X-Project-Name: tempest-ServersNegativeTestJSON-1472676568 Apr 14 11:03:50 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:03:50 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:03:50 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be1c0764b8a843808158644eb90704e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be1c0764b8a843808158644eb90704e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be1c0764b8a843808158644eb90704e6"}]}] Apr 14 11:03:50 user devstack@n-api.service[61841]: X-Tenant: tempest-ServersNegativeTestJSON-1472676568 Apr 14 11:03:50 user devstack@n-api.service[61841]: X-Tenant-Id: be1c0764b8a843808158644eb90704e6 Apr 14 11:03:50 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1472676568 Apr 14 11:03:50 user devstack@n-api.service[61841]: X-User: tempest-ServersNegativeTestJSON-1472676568-project-member Apr 14 11:03:50 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:03:50 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:03:50 user devstack@n-api.service[61841]: X-User-Id: b3f2157c5d4d441db80ea4a3ca60e4dc Apr 14 11:03:50 user devstack@n-api.service[61841]: X-User-Name: tempest-ServersNegativeTestJSON-1472676568-project-member Apr 14 11:03:50 user devstack@n-api.service[61841]: method: > Apr 14 11:03:50 user devstack@n-api.service[61841]: exception: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. Apr 14 11:03:50 user devstack@n-api.service[61841]: action_args: {'id': 'ade9eacb-d4f9-406d-85c4-043037a4b6ba'} Apr 14 11:03:50 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. Apr 14 11:03:50 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-61512508-b241-48e1-a740-77d7f0b3dade tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Returning 404 to user: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:03:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-61512508-b241-48e1-a740-77d7f0b3dade tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba" status: 404 len: 111 microversion: 2.1 time: 0.045450 Apr 14 11:03:50 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 316/941] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:03:50 2023] DELETE /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-558fd352-0ca5-4aa4-9c7a-a4406aa3377a tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-558fd352-0ca5-4aa4-9c7a-a4406aa3377a tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-558fd352-0ca5-4aa4-9c7a-a4406aa3377a tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-558fd352-0ca5-4aa4-9c7a-a4406aa3377a tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-558fd352-0ca5-4aa4-9c7a-a4406aa3377a tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-558fd352-0ca5-4aa4-9c7a-a4406aa3377a tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-558fd352-0ca5-4aa4-9c7a-a4406aa3377a tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-558fd352-0ca5-4aa4-9c7a-a4406aa3377a tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-558fd352-0ca5-4aa4-9c7a-a4406aa3377a tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] HTTP exception thrown: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-558fd352-0ca5-4aa4-9c7a-a4406aa3377a tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Request method failure captured: Apr 14 11:03:50 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba HTTP/1.1 Apr 14 11:03:50 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:03:50 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:03:50 user devstack@n-api.service[61840]: Connection: close Apr 14 11:03:50 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:03:50 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:03:50 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:03:50 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:03:50 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:03:50 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTEIFQshLfVvHk6zzMGyR_oC5LUKpIB3AE99vu24J4VUKIZ_I-EwK7Y3I7wnUHCRWCubyFlBrfn9xQqhiAoc3tpsRHBshn37If4FOH70hV1TDB1AZ7SkDOxW_ds35MJgoa5aV2nhuLsDoazuYmrCamSynjx9Vk7fjpVlXk7fFD9b_oc Apr 14 11:03:50 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:03:50 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:03:50 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:03:50 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:03:50 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:03:50 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:03:50 user devstack@n-api.service[61840]: X-Project-Id: be1c0764b8a843808158644eb90704e6 Apr 14 11:03:50 user devstack@n-api.service[61840]: X-Project-Name: tempest-ServersNegativeTestJSON-1472676568 Apr 14 11:03:50 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:03:50 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:03:50 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be1c0764b8a843808158644eb90704e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be1c0764b8a843808158644eb90704e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be1c0764b8a843808158644eb90704e6"}]}] Apr 14 11:03:50 user devstack@n-api.service[61840]: X-Tenant: tempest-ServersNegativeTestJSON-1472676568 Apr 14 11:03:50 user devstack@n-api.service[61840]: X-Tenant-Id: be1c0764b8a843808158644eb90704e6 Apr 14 11:03:50 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1472676568 Apr 14 11:03:50 user devstack@n-api.service[61840]: X-User: tempest-ServersNegativeTestJSON-1472676568-project-member Apr 14 11:03:50 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:03:50 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:03:50 user devstack@n-api.service[61840]: X-User-Id: b3f2157c5d4d441db80ea4a3ca60e4dc Apr 14 11:03:50 user devstack@n-api.service[61840]: X-User-Name: tempest-ServersNegativeTestJSON-1472676568-project-member Apr 14 11:03:50 user devstack@n-api.service[61840]: method: > Apr 14 11:03:50 user devstack@n-api.service[61840]: exception: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. Apr 14 11:03:50 user devstack@n-api.service[61840]: action_args: {'id': 'ade9eacb-d4f9-406d-85c4-043037a4b6ba'} Apr 14 11:03:50 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. Apr 14 11:03:50 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-558fd352-0ca5-4aa4-9c7a-a4406aa3377a tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Returning 404 to user: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:03:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-558fd352-0ca5-4aa4-9c7a-a4406aa3377a tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba" status: 404 len: 111 microversion: 2.1 time: 0.035074 Apr 14 11:03:50 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 315/942] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:03:50 2023] GET /compute/v2.1/servers/ade9eacb-d4f9-406d-85c4-043037a4b6ba => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:03:50 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:50 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:50 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:50 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:50 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:50 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:50 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:50 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:50 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:03:50 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96" status: 204 len: 0 microversion: 2.1 time: 0.132048 Apr 14 11:03:50 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 312/943] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:03:50 2023] DELETE /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-b4c6dc6b-c2e8-40b5-8e86-5be5b29ce9f8 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-b4c6dc6b-c2e8-40b5-8e86-5be5b29ce9f8 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b4c6dc6b-c2e8-40b5-8e86-5be5b29ce9f8 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b4c6dc6b-c2e8-40b5-8e86-5be5b29ce9f8 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b4c6dc6b-c2e8-40b5-8e86-5be5b29ce9f8 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b4c6dc6b-c2e8-40b5-8e86-5be5b29ce9f8 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b4c6dc6b-c2e8-40b5-8e86-5be5b29ce9f8 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b4c6dc6b-c2e8-40b5-8e86-5be5b29ce9f8 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:50 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-b4c6dc6b-c2e8-40b5-8e86-5be5b29ce9f8 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3f2157c5d4d441db80ea4a3ca60e4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1c0764b8a843808158644eb90704e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:03:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-b4c6dc6b-c2e8-40b5-8e86-5be5b29ce9f8 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96" status: 200 len: 1501 microversion: 2.1 time: 0.185171 Apr 14 11:03:50 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 317/944] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:03:50 2023] GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96 => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-68cf728c-ec16-4790-9ca3-39ae2b0a9db8 req-2276c402-8a3c-4dfd-a20e-5994a1ca6faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f41f217-0df2-4205-9633-7dbe83f40c96", "name": "network-vif-unplugged", "status": "completed", "tag": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-68cf728c-ec16-4790-9ca3-39ae2b0a9db8 req-2276c402-8a3c-4dfd-a20e-5994a1ca6faf service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-68cf728c-ec16-4790-9ca3-39ae2b0a9db8 req-2276c402-8a3c-4dfd-a20e-5994a1ca6faf service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-68cf728c-ec16-4790-9ca3-39ae2b0a9db8 req-2276c402-8a3c-4dfd-a20e-5994a1ca6faf service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:50 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:03:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-68cf728c-ec16-4790-9ca3-39ae2b0a9db8 req-2276c402-8a3c-4dfd-a20e-5994a1ca6faf service nova] Creating event network-vif-unplugged:e3d5b9ac-d641-478c-89cc-acbbf189ee2a for instance 6f41f217-0df2-4205-9633-7dbe83f40c96 on user Apr 14 11:03:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-68cf728c-ec16-4790-9ca3-39ae2b0a9db8 req-2276c402-8a3c-4dfd-a20e-5994a1ca6faf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036932 Apr 14 11:03:50 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 316/945] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:03:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:51 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-07189cd5-8a71-4d93-8396-c6b67b54f469 req-21cfb1e6-958a-4c9b-a298-538fbaad83ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f41f217-0df2-4205-9633-7dbe83f40c96", "name": "network-vif-deleted", "tag": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:03:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-07189cd5-8a71-4d93-8396-c6b67b54f469 req-21cfb1e6-958a-4c9b-a298-538fbaad83ef service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-07189cd5-8a71-4d93-8396-c6b67b54f469 req-21cfb1e6-958a-4c9b-a298-538fbaad83ef service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-07189cd5-8a71-4d93-8396-c6b67b54f469 req-21cfb1e6-958a-4c9b-a298-538fbaad83ef service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:51 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-07189cd5-8a71-4d93-8396-c6b67b54f469 req-21cfb1e6-958a-4c9b-a298-538fbaad83ef service nova] Creating event network-vif-deleted:e3d5b9ac-d641-478c-89cc-acbbf189ee2a for instance 6f41f217-0df2-4205-9633-7dbe83f40c96 on user Apr 14 11:03:51 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-07189cd5-8a71-4d93-8396-c6b67b54f469 req-21cfb1e6-958a-4c9b-a298-538fbaad83ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093592 Apr 14 11:03:51 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 313/946] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:03:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:52 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-0dc69858-0947-4d28-9262-1e46fe7799b0 req-fde02532-1221-4d95-980e-485e90b2fe88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f41f217-0df2-4205-9633-7dbe83f40c96", "name": "network-vif-plugged", "status": "completed", "tag": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:03:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-0dc69858-0947-4d28-9262-1e46fe7799b0 req-fde02532-1221-4d95-980e-485e90b2fe88 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-0dc69858-0947-4d28-9262-1e46fe7799b0 req-fde02532-1221-4d95-980e-485e90b2fe88 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-0dc69858-0947-4d28-9262-1e46fe7799b0 req-fde02532-1221-4d95-980e-485e90b2fe88 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:52 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-0dc69858-0947-4d28-9262-1e46fe7799b0 req-fde02532-1221-4d95-980e-485e90b2fe88 service nova] Creating event network-vif-plugged:e3d5b9ac-d641-478c-89cc-acbbf189ee2a for instance 6f41f217-0df2-4205-9633-7dbe83f40c96 on user Apr 14 11:03:52 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-0dc69858-0947-4d28-9262-1e46fe7799b0 req-fde02532-1221-4d95-980e-485e90b2fe88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027805 Apr 14 11:03:52 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 318/947] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:03:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:03:54 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-4c3d3154-db52-418d-99c6-cd83557c36bb tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:03:54 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-4c3d3154-db52-418d-99c6-cd83557c36bb tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:03:54 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4c3d3154-db52-418d-99c6-cd83557c36bb tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:54 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4c3d3154-db52-418d-99c6-cd83557c36bb tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:54 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4c3d3154-db52-418d-99c6-cd83557c36bb tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:54 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4c3d3154-db52-418d-99c6-cd83557c36bb tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:03:54 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4c3d3154-db52-418d-99c6-cd83557c36bb tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:03:54 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4c3d3154-db52-418d-99c6-cd83557c36bb tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:03:54 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-4c3d3154-db52-418d-99c6-cd83557c36bb tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:03:54 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-4c3d3154-db52-418d-99c6-cd83557c36bb tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" status: 200 len: 1746 microversion: 2.1 time: 0.162911 Apr 14 11:03:54 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 317/948] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:03:54 2023] GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:04:11 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:11 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:11 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-a4976072-a067-4248-b2f8-b999c2f47837 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:04:11 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-a4976072-a067-4248-b2f8-b999c2f47837 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:04:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a4976072-a067-4248-b2f8-b999c2f47837 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a4976072-a067-4248-b2f8-b999c2f47837 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a4976072-a067-4248-b2f8-b999c2f47837 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a4976072-a067-4248-b2f8-b999c2f47837 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a4976072-a067-4248-b2f8-b999c2f47837 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a4976072-a067-4248-b2f8-b999c2f47837 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:11 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-a4976072-a067-4248-b2f8-b999c2f47837 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] HTTP exception thrown: Instance 3d70b388-155f-4e47-8352-b69c856b2000 could not be found. Apr 14 11:04:11 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-a4976072-a067-4248-b2f8-b999c2f47837 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Request method failure captured: Apr 14 11:04:11 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/3d70b388-155f-4e47-8352-b69c856b2000 HTTP/1.1 Apr 14 11:04:11 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:04:11 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:04:11 user devstack@n-api.service[61839]: Connection: close Apr 14 11:04:11 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:04:11 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:04:11 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:04:11 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:04:11 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:04:11 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTKGlMS3eQFRrRShvpHH7ZAz06SJJ3sUJ5YBp6h5a2emPtIFJtmVFwRFyaHGJzVlZdDu1XjUbnkS-vdDrOLCTuS58lzVXkfASfM2oaYSu0LruLWZBbNRUHtT4x8jzBBRP1B4z7Eb0XL_tGHDiBls26ZkOL-PcAOihSmqwveChPESx8M Apr 14 11:04:11 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:04:11 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:04:11 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:04:11 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:04:11 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:04:11 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:04:11 user devstack@n-api.service[61839]: X-Project-Id: 1310da753ca94b38a7c660b8613af044 Apr 14 11:04:11 user devstack@n-api.service[61839]: X-Project-Name: tempest-VolumesActionsTest-1201626915 Apr 14 11:04:11 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:04:11 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:04:11 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1310da753ca94b38a7c660b8613af044"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1310da753ca94b38a7c660b8613af044"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1310da753ca94b38a7c660b8613af044"}]}] Apr 14 11:04:11 user devstack@n-api.service[61839]: X-Tenant: tempest-VolumesActionsTest-1201626915 Apr 14 11:04:11 user devstack@n-api.service[61839]: X-Tenant-Id: 1310da753ca94b38a7c660b8613af044 Apr 14 11:04:11 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-VolumesActionsTest-1201626915 Apr 14 11:04:11 user devstack@n-api.service[61839]: X-User: tempest-VolumesActionsTest-1201626915-project-member Apr 14 11:04:11 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:04:11 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:04:11 user devstack@n-api.service[61839]: X-User-Id: 282af802879e463ea87844b5fc926692 Apr 14 11:04:11 user devstack@n-api.service[61839]: X-User-Name: tempest-VolumesActionsTest-1201626915-project-member Apr 14 11:04:11 user devstack@n-api.service[61839]: method: > Apr 14 11:04:11 user devstack@n-api.service[61839]: exception: Instance 3d70b388-155f-4e47-8352-b69c856b2000 could not be found. Apr 14 11:04:11 user devstack@n-api.service[61839]: action_args: {'id': '3d70b388-155f-4e47-8352-b69c856b2000'} Apr 14 11:04:11 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d70b388-155f-4e47-8352-b69c856b2000 could not be found. Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d70b388-155f-4e47-8352-b69c856b2000 could not be found. Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d70b388-155f-4e47-8352-b69c856b2000 could not be found. Apr 14 11:04:11 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:04:11 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-a4976072-a067-4248-b2f8-b999c2f47837 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Returning 404 to user: Instance 3d70b388-155f-4e47-8352-b69c856b2000 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:04:11 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-a4976072-a067-4248-b2f8-b999c2f47837 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d70b388-155f-4e47-8352-b69c856b2000" status: 404 len: 111 microversion: 2.1 time: 0.036435 Apr 14 11:04:11 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 314/949] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:04:11 2023] GET /compute/v2.1/servers/3d70b388-155f-4e47-8352-b69c856b2000 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=8 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=16 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-611211991", "imageRef": "048ec0ee-0465-448d-8b4c-f072acb101dc", "flavorRef": "42", "networks": [{"uuid": "9614cf7a-420b-4226-9189-a89f3f4e6340"}]}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG nova.network.neutron [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] validate_networks() for [('9614cf7a-420b-4226-9189-a89f3f4e6340', None, None, None, None, None)] {{(pid=61841) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Flavor limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Image limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Flavor pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Image pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Getting quotas for project 1310da753ca94b38a7c660b8613af044. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Getting quotas for user 282af802879e463ea87844b5fc926692 and project 1310da753ca94b38a7c660b8613af044. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Going to run 1 instances... {{(pid=61841) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:04:11 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='048ec0ee-0465-448d-8b4c-f072acb101dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61841) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:04:11 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.648970 Apr 14 11:04:11 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 319/950] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:04:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:04:11 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-bbd339ab-e23a-4b21-b853-7eb5fd90ed45 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:04:11 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-bbd339ab-e23a-4b21-b853-7eb5fd90ed45 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:04:11 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:11 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=7 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:11 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-bbd339ab-e23a-4b21-b853-7eb5fd90ed45 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282af802879e463ea87844b5fc926692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310da753ca94b38a7c660b8613af044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:04:11 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-bbd339ab-e23a-4b21-b853-7eb5fd90ed45 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/269aa265-9398-4692-8ab4-f3bf5be82714" status: 200 len: 1207 microversion: 2.1 time: 0.068258 Apr 14 11:04:11 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 318/951] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:04:11 2023] GET /compute/v2.1/servers/269aa265-9398-4692-8ab4-f3bf5be82714 => generated 1207 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:04:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-cf9bebce-3a0c-4a47-a61e-2a62c6f48af1 req-41b25278-3b17-4461-a0a8-ec0f7f47a7fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269aa265-9398-4692-8ab4-f3bf5be82714", "tag": "71f5b8c7-15e0-485a-8632-01ed76e9ad91"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:04:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cf9bebce-3a0c-4a47-a61e-2a62c6f48af1 req-41b25278-3b17-4461-a0a8-ec0f7f47a7fa service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cf9bebce-3a0c-4a47-a61e-2a62c6f48af1 req-41b25278-3b17-4461-a0a8-ec0f7f47a7fa service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cf9bebce-3a0c-4a47-a61e-2a62c6f48af1 req-41b25278-3b17-4461-a0a8-ec0f7f47a7fa service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-cf9bebce-3a0c-4a47-a61e-2a62c6f48af1 req-41b25278-3b17-4461-a0a8-ec0f7f47a7fa service nova] Creating event network-changed:71f5b8c7-15e0-485a-8632-01ed76e9ad91 for instance 269aa265-9398-4692-8ab4-f3bf5be82714 on user Apr 14 11:04:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-cf9bebce-3a0c-4a47-a61e-2a62c6f48af1 req-41b25278-3b17-4461-a0a8-ec0f7f47a7fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057085 Apr 14 11:04:14 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 315/952] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:04:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:04:16 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-6cf08f46-439a-4fd8-b0af-8f02b2d03690 req-2d55cf38-bd6e-47c0-b2b1-8cde8ca7b25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269aa265-9398-4692-8ab4-f3bf5be82714", "name": "network-vif-plugged", "status": "completed", "tag": "71f5b8c7-15e0-485a-8632-01ed76e9ad91"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:04:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6cf08f46-439a-4fd8-b0af-8f02b2d03690 req-2d55cf38-bd6e-47c0-b2b1-8cde8ca7b25d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6cf08f46-439a-4fd8-b0af-8f02b2d03690 req-2d55cf38-bd6e-47c0-b2b1-8cde8ca7b25d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:16 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-6cf08f46-439a-4fd8-b0af-8f02b2d03690 req-2d55cf38-bd6e-47c0-b2b1-8cde8ca7b25d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:16 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-6cf08f46-439a-4fd8-b0af-8f02b2d03690 req-2d55cf38-bd6e-47c0-b2b1-8cde8ca7b25d service nova] Creating event network-vif-plugged:71f5b8c7-15e0-485a-8632-01ed76e9ad91 for instance 269aa265-9398-4692-8ab4-f3bf5be82714 on user Apr 14 11:04:16 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-6cf08f46-439a-4fd8-b0af-8f02b2d03690 req-2d55cf38-bd6e-47c0-b2b1-8cde8ca7b25d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095871 Apr 14 11:04:16 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 320/953] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:04:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:04:18 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-99e30b72-e348-4376-a84a-47435a3965c4 req-c3cc75c8-4e2e-431b-add6-fca9784fbc6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269aa265-9398-4692-8ab4-f3bf5be82714", "name": "network-vif-plugged", "status": "completed", "tag": "71f5b8c7-15e0-485a-8632-01ed76e9ad91"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:04:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-99e30b72-e348-4376-a84a-47435a3965c4 req-c3cc75c8-4e2e-431b-add6-fca9784fbc6b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-99e30b72-e348-4376-a84a-47435a3965c4 req-c3cc75c8-4e2e-431b-add6-fca9784fbc6b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:18 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-99e30b72-e348-4376-a84a-47435a3965c4 req-c3cc75c8-4e2e-431b-add6-fca9784fbc6b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-99e30b72-e348-4376-a84a-47435a3965c4 req-c3cc75c8-4e2e-431b-add6-fca9784fbc6b service nova] Creating event network-vif-plugged:71f5b8c7-15e0-485a-8632-01ed76e9ad91 for instance 269aa265-9398-4692-8ab4-f3bf5be82714 on user Apr 14 11:04:18 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-99e30b72-e348-4376-a84a-47435a3965c4 req-c3cc75c8-4e2e-431b-add6-fca9784fbc6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028475 Apr 14 11:04:18 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 319/954] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:04:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:04:21 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:04:21 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:04:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:21 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:21 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:04:21 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177" status: 204 len: 0 microversion: 2.87 time: 0.120264 Apr 14 11:04:21 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 316/955] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 11:04:21 2023] DELETE /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 11:04:21 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:21 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:21 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-2bd1b8a3-7a14-422e-a659-a99d314b2e08 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:04:21 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-2bd1b8a3-7a14-422e-a659-a99d314b2e08 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:04:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2bd1b8a3-7a14-422e-a659-a99d314b2e08 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2bd1b8a3-7a14-422e-a659-a99d314b2e08 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2bd1b8a3-7a14-422e-a659-a99d314b2e08 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2bd1b8a3-7a14-422e-a659-a99d314b2e08 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2bd1b8a3-7a14-422e-a659-a99d314b2e08 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:21 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2bd1b8a3-7a14-422e-a659-a99d314b2e08 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:22 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-2bd1b8a3-7a14-422e-a659-a99d314b2e08 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:04:22 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-2bd1b8a3-7a14-422e-a659-a99d314b2e08 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:04:22 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-2bd1b8a3-7a14-422e-a659-a99d314b2e08 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:04:22 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-2bd1b8a3-7a14-422e-a659-a99d314b2e08 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177" status: 200 len: 1776 microversion: 2.87 time: 0.216398 Apr 14 11:04:22 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 321/956] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:04:21 2023] GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177 => generated 1776 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:04:22 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:22 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-4c1bb9d4-7477-49db-889d-cf50c6d50fae req-15465bab-931f-417c-9c6b-91d3eab79bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcca78c-fe73-4ef1-92f9-4c8061cad177", "name": "network-vif-unplugged", "status": "completed", "tag": "845cc40f-1b03-4b85-8d19-fea731fe7f89"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:04:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-4c1bb9d4-7477-49db-889d-cf50c6d50fae req-15465bab-931f-417c-9c6b-91d3eab79bde service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-4c1bb9d4-7477-49db-889d-cf50c6d50fae req-15465bab-931f-417c-9c6b-91d3eab79bde service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:22 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-4c1bb9d4-7477-49db-889d-cf50c6d50fae req-15465bab-931f-417c-9c6b-91d3eab79bde service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:22 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-4c1bb9d4-7477-49db-889d-cf50c6d50fae req-15465bab-931f-417c-9c6b-91d3eab79bde service nova] Creating event network-vif-unplugged:845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 on user Apr 14 11:04:22 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-4c1bb9d4-7477-49db-889d-cf50c6d50fae req-15465bab-931f-417c-9c6b-91d3eab79bde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045408 Apr 14 11:04:22 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 320/957] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:04:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:04:23 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-91f1876f-4102-4b0f-926e-646d358f6eb7 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:04:23 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-91f1876f-4102-4b0f-926e-646d358f6eb7 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:04:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91f1876f-4102-4b0f-926e-646d358f6eb7 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91f1876f-4102-4b0f-926e-646d358f6eb7 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91f1876f-4102-4b0f-926e-646d358f6eb7 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91f1876f-4102-4b0f-926e-646d358f6eb7 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91f1876f-4102-4b0f-926e-646d358f6eb7 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:23 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91f1876f-4102-4b0f-926e-646d358f6eb7 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:23 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-91f1876f-4102-4b0f-926e-646d358f6eb7 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] HTTP exception thrown: Instance a1fdcfb4-8700-48fe-9dec-1e8a4b766cba could not be found. Apr 14 11:04:23 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-91f1876f-4102-4b0f-926e-646d358f6eb7 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Request method failure captured: Apr 14 11:04:23 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba HTTP/1.1 Apr 14 11:04:23 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:04:23 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:04:23 user devstack@n-api.service[61839]: Connection: close Apr 14 11:04:23 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:04:23 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:04:23 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:04:23 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:04:23 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:04:23 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTKMTZhoY5WPhjyjjqHmFEmQXcxxM3KfBft_v-nA6t3gUv7zj9OoTmSNpbh3nA8AA_oADcJ6W--JSx4OAS4g75OjJXGA8USRZAMb1dNMkXR7uvnvFXz1BzpxrbPkc1C8RHlPBLpulUK7U020bREPJ6r0YSxHltQzZddX4XZsQ28wHU0 Apr 14 11:04:23 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:04:23 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:04:23 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:04:23 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:04:23 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:04:23 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:04:23 user devstack@n-api.service[61839]: X-Project-Id: 000980e0e886468b8df32c7373cde033 Apr 14 11:04:23 user devstack@n-api.service[61839]: X-Project-Name: tempest-VolumesActionsTest-1402991140 Apr 14 11:04:23 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:04:23 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:04:23 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/000980e0e886468b8df32c7373cde033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/000980e0e886468b8df32c7373cde033"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/000980e0e886468b8df32c7373cde033"}]}] Apr 14 11:04:23 user devstack@n-api.service[61839]: X-Tenant: tempest-VolumesActionsTest-1402991140 Apr 14 11:04:23 user devstack@n-api.service[61839]: X-Tenant-Id: 000980e0e886468b8df32c7373cde033 Apr 14 11:04:23 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-VolumesActionsTest-1402991140 Apr 14 11:04:23 user devstack@n-api.service[61839]: X-User: tempest-VolumesActionsTest-1402991140-project-member Apr 14 11:04:23 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:04:23 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:04:23 user devstack@n-api.service[61839]: X-User-Id: c9ae4725537b4162b88b3eed27666bc0 Apr 14 11:04:23 user devstack@n-api.service[61839]: X-User-Name: tempest-VolumesActionsTest-1402991140-project-member Apr 14 11:04:23 user devstack@n-api.service[61839]: method: > Apr 14 11:04:23 user devstack@n-api.service[61839]: exception: Instance a1fdcfb4-8700-48fe-9dec-1e8a4b766cba could not be found. Apr 14 11:04:23 user devstack@n-api.service[61839]: action_args: {'id': 'a1fdcfb4-8700-48fe-9dec-1e8a4b766cba'} Apr 14 11:04:23 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1fdcfb4-8700-48fe-9dec-1e8a4b766cba could not be found. Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1fdcfb4-8700-48fe-9dec-1e8a4b766cba could not be found. Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1fdcfb4-8700-48fe-9dec-1e8a4b766cba could not be found. Apr 14 11:04:23 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:04:23 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-91f1876f-4102-4b0f-926e-646d358f6eb7 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Returning 404 to user: Instance a1fdcfb4-8700-48fe-9dec-1e8a4b766cba could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:04:23 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-91f1876f-4102-4b0f-926e-646d358f6eb7 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" status: 404 len: 111 microversion: 2.1 time: 0.030187 Apr 14 11:04:23 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 317/958] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:04:23 2023] GET /compute/v2.1/servers/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:04:24 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-c9b7f1ca-d807-4bbe-854c-9ec0b317054c req-5943c720-f2dc-415c-aefa-1fc70ecee96c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcca78c-fe73-4ef1-92f9-4c8061cad177", "name": "network-vif-plugged", "status": "completed", "tag": "845cc40f-1b03-4b85-8d19-fea731fe7f89"}, {"server_uuid": "fbcca78c-fe73-4ef1-92f9-4c8061cad177", "name": "network-vif-deleted", "tag": "845cc40f-1b03-4b85-8d19-fea731fe7f89"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:04:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-c9b7f1ca-d807-4bbe-854c-9ec0b317054c req-5943c720-f2dc-415c-aefa-1fc70ecee96c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-c9b7f1ca-d807-4bbe-854c-9ec0b317054c req-5943c720-f2dc-415c-aefa-1fc70ecee96c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:24 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-c9b7f1ca-d807-4bbe-854c-9ec0b317054c req-5943c720-f2dc-415c-aefa-1fc70ecee96c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:24 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-c9b7f1ca-d807-4bbe-854c-9ec0b317054c req-5943c720-f2dc-415c-aefa-1fc70ecee96c service nova] Creating event network-vif-plugged:845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 on user Apr 14 11:04:24 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-c9b7f1ca-d807-4bbe-854c-9ec0b317054c req-5943c720-f2dc-415c-aefa-1fc70ecee96c service nova] Creating event network-vif-deleted:845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 on user Apr 14 11:04:24 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-c9b7f1ca-d807-4bbe-854c-9ec0b317054c req-5943c720-f2dc-415c-aefa-1fc70ecee96c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031511 Apr 14 11:04:24 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 322/959] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:04:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:04:34 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=8 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:34 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:34 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-2e4e9b17-861c-45ff-b3f5-86aee3319e5c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:04:34 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-2e4e9b17-861c-45ff-b3f5-86aee3319e5c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:04:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2e4e9b17-861c-45ff-b3f5-86aee3319e5c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2e4e9b17-861c-45ff-b3f5-86aee3319e5c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2e4e9b17-861c-45ff-b3f5-86aee3319e5c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2e4e9b17-861c-45ff-b3f5-86aee3319e5c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2e4e9b17-861c-45ff-b3f5-86aee3319e5c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2e4e9b17-861c-45ff-b3f5-86aee3319e5c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-2e4e9b17-861c-45ff-b3f5-86aee3319e5c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086087 Apr 14 11:04:34 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 321/960] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:04:33 2023] GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 11:04:34 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:04:34 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:04:34 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:34 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:34 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:04:34 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813" status: 204 len: 0 microversion: 2.1 time: 0.174870 Apr 14 11:04:34 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 318/961] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:04:34 2023] DELETE /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:04:34 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:34 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=12 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:34 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-eda3e0bb-f753-449a-add8-5c5da4a2c56a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:04:34 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-eda3e0bb-f753-449a-add8-5c5da4a2c56a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:04:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-eda3e0bb-f753-449a-add8-5c5da4a2c56a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-eda3e0bb-f753-449a-add8-5c5da4a2c56a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-eda3e0bb-f753-449a-add8-5c5da4a2c56a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-eda3e0bb-f753-449a-add8-5c5da4a2c56a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-eda3e0bb-f753-449a-add8-5c5da4a2c56a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-eda3e0bb-f753-449a-add8-5c5da4a2c56a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:34 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-eda3e0bb-f753-449a-add8-5c5da4a2c56a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:04:34 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-eda3e0bb-f753-449a-add8-5c5da4a2c56a tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813" status: 200 len: 1670 microversion: 2.1 time: 0.371306 Apr 14 11:04:34 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 323/962] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:04:34 2023] GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813 => generated 1670 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:04:34 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-f3cc1828-296f-4a95-aa4d-80938969cd2c req-8b394876-4de7-41a4-bb3f-74fdcbd13ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96e2a1a-8c1b-4189-86b9-a3c1761a9813", "name": "network-vif-unplugged", "status": "completed", "tag": "7ee72a8e-db85-4e30-91e5-193e21c386cd"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:04:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f3cc1828-296f-4a95-aa4d-80938969cd2c req-8b394876-4de7-41a4-bb3f-74fdcbd13ccc service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f3cc1828-296f-4a95-aa4d-80938969cd2c req-8b394876-4de7-41a4-bb3f-74fdcbd13ccc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:34 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f3cc1828-296f-4a95-aa4d-80938969cd2c req-8b394876-4de7-41a4-bb3f-74fdcbd13ccc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-f3cc1828-296f-4a95-aa4d-80938969cd2c req-8b394876-4de7-41a4-bb3f-74fdcbd13ccc service nova] Creating event network-vif-unplugged:7ee72a8e-db85-4e30-91e5-193e21c386cd for instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 on user Apr 14 11:04:34 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-f3cc1828-296f-4a95-aa4d-80938969cd2c req-8b394876-4de7-41a4-bb3f-74fdcbd13ccc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063995 Apr 14 11:04:34 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 322/963] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:04:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:04:36 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-016b092b-4d05-43c9-9ea3-f27e9c9a0870 req-ea67f58e-3eca-41cf-b73a-be81053def47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96e2a1a-8c1b-4189-86b9-a3c1761a9813", "name": "network-vif-deleted", "tag": "7ee72a8e-db85-4e30-91e5-193e21c386cd"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:04:36 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-016b092b-4d05-43c9-9ea3-f27e9c9a0870 req-ea67f58e-3eca-41cf-b73a-be81053def47 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:36 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-016b092b-4d05-43c9-9ea3-f27e9c9a0870 req-ea67f58e-3eca-41cf-b73a-be81053def47 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:36 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-016b092b-4d05-43c9-9ea3-f27e9c9a0870 req-ea67f58e-3eca-41cf-b73a-be81053def47 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:36 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-016b092b-4d05-43c9-9ea3-f27e9c9a0870 req-ea67f58e-3eca-41cf-b73a-be81053def47 service nova] Creating event network-vif-deleted:7ee72a8e-db85-4e30-91e5-193e21c386cd for instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 on user Apr 14 11:04:36 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-016b092b-4d05-43c9-9ea3-f27e9c9a0870 req-ea67f58e-3eca-41cf-b73a-be81053def47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040761 Apr 14 11:04:36 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 319/964] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:04:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:04:36 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-a66a4642-d8d0-4688-8628-abbf9f09b42f req-eac95707-4f5d-4544-8622-9be22cc5f441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96e2a1a-8c1b-4189-86b9-a3c1761a9813", "name": "network-vif-plugged", "status": "completed", "tag": "7ee72a8e-db85-4e30-91e5-193e21c386cd"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:04:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-a66a4642-d8d0-4688-8628-abbf9f09b42f req-eac95707-4f5d-4544-8622-9be22cc5f441 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-a66a4642-d8d0-4688-8628-abbf9f09b42f req-eac95707-4f5d-4544-8622-9be22cc5f441 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-a66a4642-d8d0-4688-8628-abbf9f09b42f req-eac95707-4f5d-4544-8622-9be22cc5f441 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:36 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-a66a4642-d8d0-4688-8628-abbf9f09b42f req-eac95707-4f5d-4544-8622-9be22cc5f441 service nova] Creating event network-vif-plugged:7ee72a8e-db85-4e30-91e5-193e21c386cd for instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 on user Apr 14 11:04:36 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-a66a4642-d8d0-4688-8628-abbf9f09b42f req-eac95707-4f5d-4544-8622-9be22cc5f441 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032521 Apr 14 11:04:36 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 324/965] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:04:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:04:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-703a1136-7cae-4277-baad-be2f3c997c47 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:04:40 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-703a1136-7cae-4277-baad-be2f3c997c47 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:04:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-703a1136-7cae-4277-baad-be2f3c997c47 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-703a1136-7cae-4277-baad-be2f3c997c47 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-703a1136-7cae-4277-baad-be2f3c997c47 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-703a1136-7cae-4277-baad-be2f3c997c47 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-703a1136-7cae-4277-baad-be2f3c997c47 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-703a1136-7cae-4277-baad-be2f3c997c47 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-703a1136-7cae-4277-baad-be2f3c997c47 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] HTTP exception thrown: Instance 6f41f217-0df2-4205-9633-7dbe83f40c96 could not be found. Apr 14 11:04:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-703a1136-7cae-4277-baad-be2f3c997c47 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Request method failure captured: Apr 14 11:04:40 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96 HTTP/1.1 Apr 14 11:04:40 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:04:40 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:04:40 user devstack@n-api.service[61840]: Connection: close Apr 14 11:04:40 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:04:40 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:04:40 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:04:40 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:04:40 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:04:40 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTEIFQshLfVvHk6zzMGyR_oC5LUKpIB3AE99vu24J4VUKIZ_I-EwK7Y3I7wnUHCRWCubyFlBrfn9xQqhiAoc3tpsRHBshn37If4FOH70hV1TDB1AZ7SkDOxW_ds35MJgoa5aV2nhuLsDoazuYmrCamSynjx9Vk7fjpVlXk7fFD9b_oc Apr 14 11:04:40 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:04:40 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:04:40 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:04:40 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:04:40 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:04:40 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:04:40 user devstack@n-api.service[61840]: X-Project-Id: be1c0764b8a843808158644eb90704e6 Apr 14 11:04:40 user devstack@n-api.service[61840]: X-Project-Name: tempest-ServersNegativeTestJSON-1472676568 Apr 14 11:04:40 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:04:40 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:04:40 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be1c0764b8a843808158644eb90704e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be1c0764b8a843808158644eb90704e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be1c0764b8a843808158644eb90704e6"}]}] Apr 14 11:04:40 user devstack@n-api.service[61840]: X-Tenant: tempest-ServersNegativeTestJSON-1472676568 Apr 14 11:04:40 user devstack@n-api.service[61840]: X-Tenant-Id: be1c0764b8a843808158644eb90704e6 Apr 14 11:04:40 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1472676568 Apr 14 11:04:40 user devstack@n-api.service[61840]: X-User: tempest-ServersNegativeTestJSON-1472676568-project-member Apr 14 11:04:40 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:04:40 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:04:40 user devstack@n-api.service[61840]: X-User-Id: b3f2157c5d4d441db80ea4a3ca60e4dc Apr 14 11:04:40 user devstack@n-api.service[61840]: X-User-Name: tempest-ServersNegativeTestJSON-1472676568-project-member Apr 14 11:04:40 user devstack@n-api.service[61840]: method: > Apr 14 11:04:40 user devstack@n-api.service[61840]: exception: Instance 6f41f217-0df2-4205-9633-7dbe83f40c96 could not be found. Apr 14 11:04:40 user devstack@n-api.service[61840]: action_args: {'id': '6f41f217-0df2-4205-9633-7dbe83f40c96'} Apr 14 11:04:40 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f41f217-0df2-4205-9633-7dbe83f40c96 could not be found. Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f41f217-0df2-4205-9633-7dbe83f40c96 could not be found. Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f41f217-0df2-4205-9633-7dbe83f40c96 could not be found. Apr 14 11:04:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:04:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-703a1136-7cae-4277-baad-be2f3c997c47 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Returning 404 to user: Instance 6f41f217-0df2-4205-9633-7dbe83f40c96 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:04:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-703a1136-7cae-4277-baad-be2f3c997c47 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96" status: 404 len: 111 microversion: 2.1 time: 0.030491 Apr 14 11:04:40 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 323/966] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:04:40 2023] GET /compute/v2.1/servers/6f41f217-0df2-4205-9633-7dbe83f40c96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:04:43 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f6701975-efe0-4143-8269-3509f74ccbfa tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:04:43 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-f6701975-efe0-4143-8269-3509f74ccbfa tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:04:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f6701975-efe0-4143-8269-3509f74ccbfa tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f6701975-efe0-4143-8269-3509f74ccbfa tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f6701975-efe0-4143-8269-3509f74ccbfa tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f6701975-efe0-4143-8269-3509f74ccbfa tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f6701975-efe0-4143-8269-3509f74ccbfa tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f6701975-efe0-4143-8269-3509f74ccbfa tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:43 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-f6701975-efe0-4143-8269-3509f74ccbfa tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:04:43 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-f6701975-efe0-4143-8269-3509f74ccbfa tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e" status: 200 len: 1547 microversion: 2.1 time: 0.298848 Apr 14 11:04:43 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 320/967] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:04:43 2023] GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e => generated 1547 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:04:43 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-31dc092e-0bc7-43d1-9f75-70380041148d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:04:44 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-31dc092e-0bc7-43d1-9f75-70380041148d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:04:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-31dc092e-0bc7-43d1-9f75-70380041148d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-31dc092e-0bc7-43d1-9f75-70380041148d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-31dc092e-0bc7-43d1-9f75-70380041148d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-31dc092e-0bc7-43d1-9f75-70380041148d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-31dc092e-0bc7-43d1-9f75-70380041148d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-31dc092e-0bc7-43d1-9f75-70380041148d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:44 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-31dc092e-0bc7-43d1-9f75-70380041148d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e/action" status: 200 len: 28542 microversion: 2.1 time: 0.223186 Apr 14 11:04:44 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 325/968] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 11:04:43 2023] POST /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e/action => generated 28542 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 11:04:44 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-c5e3fd91-41e1-4515-9205-4eff5a64d2f0 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:04:44 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-c5e3fd91-41e1-4515-9205-4eff5a64d2f0 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:04:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c5e3fd91-41e1-4515-9205-4eff5a64d2f0 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c5e3fd91-41e1-4515-9205-4eff5a64d2f0 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c5e3fd91-41e1-4515-9205-4eff5a64d2f0 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c5e3fd91-41e1-4515-9205-4eff5a64d2f0 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c5e3fd91-41e1-4515-9205-4eff5a64d2f0 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-c5e3fd91-41e1-4515-9205-4eff5a64d2f0 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:44 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-c5e3fd91-41e1-4515-9205-4eff5a64d2f0 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:04:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-c5e3fd91-41e1-4515-9205-4eff5a64d2f0 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" status: 200 len: 1539 microversion: 2.1 time: 0.163408 Apr 14 11:04:44 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 324/969] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:04:44 2023] GET /compute/v2.1/servers/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 => generated 1539 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:04:54 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-91fe126f-6d1d-49ba-95de-5aea8d17a624 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-645258552"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:04:54 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-91fe126f-6d1d-49ba-95de-5aea8d17a624 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:04:54 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:54 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91fe126f-6d1d-49ba-95de-5aea8d17a624 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91fe126f-6d1d-49ba-95de-5aea8d17a624 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91fe126f-6d1d-49ba-95de-5aea8d17a624 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91fe126f-6d1d-49ba-95de-5aea8d17a624 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91fe126f-6d1d-49ba-95de-5aea8d17a624 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-91fe126f-6d1d-49ba-95de-5aea8d17a624 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:54 user devstack@n-api.service[61839]: INFO nova.network.security_group_api [None req-91fe126f-6d1d-49ba-95de-5aea8d17a624 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Removing security group fa72c410-b997-4799-99e3-2bf5b3e1d7ca from port f41f6957-bf6d-47bf-bb71-638137929e1e Apr 14 11:04:55 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-91fe126f-6d1d-49ba-95de-5aea8d17a624 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/action" status: 202 len: 0 microversion: 2.1 time: 0.783564 Apr 14 11:04:55 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 321/970] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 11:04:54 2023] POST /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/action => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:04:55 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-277d0a7b-a95a-4a9d-804e-c3f1a60536a1 req-577857d9-b879-46bd-a269-95ad2f2d1057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:04:55 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:55 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=12 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-277d0a7b-a95a-4a9d-804e-c3f1a60536a1 req-577857d9-b879-46bd-a269-95ad2f2d1057 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-277d0a7b-a95a-4a9d-804e-c3f1a60536a1 req-577857d9-b879-46bd-a269-95ad2f2d1057 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-277d0a7b-a95a-4a9d-804e-c3f1a60536a1 req-577857d9-b879-46bd-a269-95ad2f2d1057 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:55 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-277d0a7b-a95a-4a9d-804e-c3f1a60536a1 req-577857d9-b879-46bd-a269-95ad2f2d1057 service nova] Creating event network-changed:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:04:55 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-277d0a7b-a95a-4a9d-804e-c3f1a60536a1 req-577857d9-b879-46bd-a269-95ad2f2d1057 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050489 Apr 14 11:04:55 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 326/971] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:04:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:04:56 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-7fa38689-45bd-4df7-bceb-8d4905f6d352 req-c7d7c28c-a089-4123-9343-c7560dfb3c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:04:56 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=8 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:56 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=16 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:04:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-7fa38689-45bd-4df7-bceb-8d4905f6d352 req-c7d7c28c-a089-4123-9343-c7560dfb3c39 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-7fa38689-45bd-4df7-bceb-8d4905f6d352 req-c7d7c28c-a089-4123-9343-c7560dfb3c39 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-7fa38689-45bd-4df7-bceb-8d4905f6d352 req-c7d7c28c-a089-4123-9343-c7560dfb3c39 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:56 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-7fa38689-45bd-4df7-bceb-8d4905f6d352 req-c7d7c28c-a089-4123-9343-c7560dfb3c39 service nova] Creating event network-changed:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:04:56 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-7fa38689-45bd-4df7-bceb-8d4905f6d352 req-c7d7c28c-a089-4123-9343-c7560dfb3c39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041057 Apr 14 11:04:56 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 325/972] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:04:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:04:56 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:04:56 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:04:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:56 user devstack@n-api.service[61839]: DEBUG nova.objects.instance [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'services' on Instance uuid 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 {{(pid=61839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 11:04:56 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/os-volume_attachments/0da1ed17-2b8c-4dd3-a61a-1133a9420d21" status: 202 len: 0 microversion: 2.1 time: 0.227092 Apr 14 11:04:56 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 322/973] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 11:04:56 2023] DELETE /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/os-volume_attachments/0da1ed17-2b8c-4dd3-a61a-1133a9420d21 => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:04:56 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-0077cfeb-2889-4a00-8de7-e9477addfe87 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:04:56 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-0077cfeb-2889-4a00-8de7-e9477addfe87 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:04:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0077cfeb-2889-4a00-8de7-e9477addfe87 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0077cfeb-2889-4a00-8de7-e9477addfe87 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0077cfeb-2889-4a00-8de7-e9477addfe87 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0077cfeb-2889-4a00-8de7-e9477addfe87 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:04:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0077cfeb-2889-4a00-8de7-e9477addfe87 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:04:56 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-0077cfeb-2889-4a00-8de7-e9477addfe87 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:04:56 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-0077cfeb-2889-4a00-8de7-e9477addfe87 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065656 Apr 14 11:04:56 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 327/974] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:04:56 2023] GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:05:02 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-23080df6-f74b-4278-b681-fc6275c6686d tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:02 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-23080df6-f74b-4278-b681-fc6275c6686d tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23080df6-f74b-4278-b681-fc6275c6686d tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23080df6-f74b-4278-b681-fc6275c6686d tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23080df6-f74b-4278-b681-fc6275c6686d tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23080df6-f74b-4278-b681-fc6275c6686d tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23080df6-f74b-4278-b681-fc6275c6686d tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:02 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23080df6-f74b-4278-b681-fc6275c6686d tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:02 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-23080df6-f74b-4278-b681-fc6275c6686d tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282af802879e463ea87844b5fc926692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310da753ca94b38a7c660b8613af044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:05:02 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-23080df6-f74b-4278-b681-fc6275c6686d tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/269aa265-9398-4692-8ab4-f3bf5be82714" status: 200 len: 1486 microversion: 2.1 time: 0.374679 Apr 14 11:05:02 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 326/975] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:05:02 2023] GET /compute/v2.1/servers/269aa265-9398-4692-8ab4-f3bf5be82714 => generated 1486 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-5491ad78-7a21-46cd-99f4-c684d7934e2f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-5491ad78-7a21-46cd-99f4-c684d7934e2f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5491ad78-7a21-46cd-99f4-c684d7934e2f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5491ad78-7a21-46cd-99f4-c684d7934e2f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5491ad78-7a21-46cd-99f4-c684d7934e2f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5491ad78-7a21-46cd-99f4-c684d7934e2f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5491ad78-7a21-46cd-99f4-c684d7934e2f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-5491ad78-7a21-46cd-99f4-c684d7934e2f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:12 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-5491ad78-7a21-46cd-99f4-c684d7934e2f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] HTTP exception thrown: Instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 could not be found. Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-5491ad78-7a21-46cd-99f4-c684d7934e2f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Request method failure captured: Apr 14 11:05:12 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177 HTTP/1.1 Apr 14 11:05:12 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:05:12 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:05:12 user devstack@n-api.service[61839]: Connection: close Apr 14 11:05:12 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:05:12 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:05:12 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:05:12 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:05:12 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS8E-UO3BI5f7b6x50N3vDY0vRMFs_uZm8-H9vMJmHi_iiDftAa0EnpcQYQbE80P6WQhfxAHEAXNgHj-2f1MRH59Q-QaVTEXSktnZkrjGNxMQhD0V9gm5P_FZkrUUJopC-KIf72jcPzhH7K40SInM3QE33ccY0pw2ZuA-2a78raF9ys Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Project-Id: 71289f80a05141f482cb538dac3d7b38 Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2130542140 Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71289f80a05141f482cb538dac3d7b38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71289f80a05141f482cb538dac3d7b38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71289f80a05141f482cb538dac3d7b38"}]}] Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2130542140 Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Tenant-Id: 71289f80a05141f482cb538dac3d7b38 Apr 14 11:05:12 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2130542140 Apr 14 11:05:12 user devstack@n-api.service[61839]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member Apr 14 11:05:12 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:05:12 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:05:12 user devstack@n-api.service[61839]: X-User-Id: 395bc9d7007c4e01ac7effd418bcea19 Apr 14 11:05:12 user devstack@n-api.service[61839]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member Apr 14 11:05:12 user devstack@n-api.service[61839]: method: > Apr 14 11:05:12 user devstack@n-api.service[61839]: exception: Instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 could not be found. Apr 14 11:05:12 user devstack@n-api.service[61839]: action_args: {'id': 'fbcca78c-fe73-4ef1-92f9-4c8061cad177'} Apr 14 11:05:12 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 could not be found. Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 could not be found. Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 could not be found. Apr 14 11:05:12 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-5491ad78-7a21-46cd-99f4-c684d7934e2f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Returning 404 to user: Instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:05:12 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-5491ad78-7a21-46cd-99f4-c684d7934e2f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177" status: 404 len: 111 microversion: 2.87 time: 0.038850 Apr 14 11:05:12 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 323/976] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:05:12 2023] GET /compute/v2.1/servers/fbcca78c-fe73-4ef1-92f9-4c8061cad177 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 11:05:12 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:12 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:12 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:05:12 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=8 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:05:12 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:12 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:12 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:12 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:12 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:12 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:12 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:05:12 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a936fb20-3f17-4114-829a-8659da6bc5f3" status: 204 len: 0 microversion: 2.87 time: 0.112946 Apr 14 11:05:12 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 328/977] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 11:05:12 2023] DELETE /compute/v2.1/servers/a936fb20-3f17-4114-829a-8659da6bc5f3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 11:05:12 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-f27dbe21-d761-48f3-b72c-36be780174aa tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:12 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-f27dbe21-d761-48f3-b72c-36be780174aa tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:12 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:05:12 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=8 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:05:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f27dbe21-d761-48f3-b72c-36be780174aa tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f27dbe21-d761-48f3-b72c-36be780174aa tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f27dbe21-d761-48f3-b72c-36be780174aa tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f27dbe21-d761-48f3-b72c-36be780174aa tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f27dbe21-d761-48f3-b72c-36be780174aa tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:12 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-f27dbe21-d761-48f3-b72c-36be780174aa tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:12 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-f27dbe21-d761-48f3-b72c-36be780174aa tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:05:12 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-f27dbe21-d761-48f3-b72c-36be780174aa tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:05:12 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-f27dbe21-d761-48f3-b72c-36be780174aa tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:05:12 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-f27dbe21-d761-48f3-b72c-36be780174aa tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a936fb20-3f17-4114-829a-8659da6bc5f3" status: 200 len: 1696 microversion: 2.87 time: 0.185132 Apr 14 11:05:12 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 327/978] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:05:12 2023] GET /compute/v2.1/servers/a936fb20-3f17-4114-829a-8659da6bc5f3 => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-68ea8e85-d528-4554-b639-4b2cd13368f5 req-6b107b6f-61df-4f48-84c6-a31077f36e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a936fb20-3f17-4114-829a-8659da6bc5f3", "name": "network-vif-unplugged", "status": "completed", "tag": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-68ea8e85-d528-4554-b639-4b2cd13368f5 req-6b107b6f-61df-4f48-84c6-a31077f36e0b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-68ea8e85-d528-4554-b639-4b2cd13368f5 req-6b107b6f-61df-4f48-84c6-a31077f36e0b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:12 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-68ea8e85-d528-4554-b639-4b2cd13368f5 req-6b107b6f-61df-4f48-84c6-a31077f36e0b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:12 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-68ea8e85-d528-4554-b639-4b2cd13368f5 req-6b107b6f-61df-4f48-84c6-a31077f36e0b service nova] Creating event network-vif-unplugged:472fc537-2bff-4ebb-bfb7-f7973f9f8b81 for instance a936fb20-3f17-4114-829a-8659da6bc5f3 on user Apr 14 11:05:12 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-68ea8e85-d528-4554-b639-4b2cd13368f5 req-6b107b6f-61df-4f48-84c6-a31077f36e0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037256 Apr 14 11:05:12 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 324/979] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:05:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 11:05:13 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-05c5cbb4-f171-4af7-8da3-184adbfd851b req-fc0fd1b2-6800-480a-9314-7f47c58492b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a936fb20-3f17-4114-829a-8659da6bc5f3", "name": "network-vif-deleted", "tag": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:05:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-05c5cbb4-f171-4af7-8da3-184adbfd851b req-fc0fd1b2-6800-480a-9314-7f47c58492b3 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-05c5cbb4-f171-4af7-8da3-184adbfd851b req-fc0fd1b2-6800-480a-9314-7f47c58492b3 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:13 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-05c5cbb4-f171-4af7-8da3-184adbfd851b req-fc0fd1b2-6800-480a-9314-7f47c58492b3 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:13 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-05c5cbb4-f171-4af7-8da3-184adbfd851b req-fc0fd1b2-6800-480a-9314-7f47c58492b3 service nova] Creating event network-vif-deleted:472fc537-2bff-4ebb-bfb7-f7973f9f8b81 for instance a936fb20-3f17-4114-829a-8659da6bc5f3 on user Apr 14 11:05:13 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-05c5cbb4-f171-4af7-8da3-184adbfd851b req-fc0fd1b2-6800-480a-9314-7f47c58492b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032023 Apr 14 11:05:13 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 329/980] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:05:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:05:14 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-c7941c48-15e3-4bb0-a268-c44613ada93a req-45953cdd-0f57-4785-afb3-edc8a8f9e2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a936fb20-3f17-4114-829a-8659da6bc5f3", "name": "network-vif-plugged", "status": "completed", "tag": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:05:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-c7941c48-15e3-4bb0-a268-c44613ada93a req-45953cdd-0f57-4785-afb3-edc8a8f9e2e2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-c7941c48-15e3-4bb0-a268-c44613ada93a req-45953cdd-0f57-4785-afb3-edc8a8f9e2e2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-c7941c48-15e3-4bb0-a268-c44613ada93a req-45953cdd-0f57-4785-afb3-edc8a8f9e2e2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:14 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-c7941c48-15e3-4bb0-a268-c44613ada93a req-45953cdd-0f57-4785-afb3-edc8a8f9e2e2 service nova] Creating event network-vif-plugged:472fc537-2bff-4ebb-bfb7-f7973f9f8b81 for instance a936fb20-3f17-4114-829a-8659da6bc5f3 on user Apr 14 11:05:14 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-c7941c48-15e3-4bb0-a268-c44613ada93a req-45953cdd-0f57-4785-afb3-edc8a8f9e2e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030047 Apr 14 11:05:14 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 328/981] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:05:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:05:24 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-ffab44bf-4c55-466b-b67b-bef7b336eecc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:24 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-ffab44bf-4c55-466b-b67b-bef7b336eecc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:24 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:05:24 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:05:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ffab44bf-4c55-466b-b67b-bef7b336eecc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ffab44bf-4c55-466b-b67b-bef7b336eecc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ffab44bf-4c55-466b-b67b-bef7b336eecc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ffab44bf-4c55-466b-b67b-bef7b336eecc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ffab44bf-4c55-466b-b67b-bef7b336eecc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:24 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-ffab44bf-4c55-466b-b67b-bef7b336eecc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:24 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-ffab44bf-4c55-466b-b67b-bef7b336eecc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HTTP exception thrown: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. Apr 14 11:05:24 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-ffab44bf-4c55-466b-b67b-bef7b336eecc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Request method failure captured: Apr 14 11:05:24 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813 HTTP/1.1 Apr 14 11:05:24 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:05:24 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:05:24 user devstack@n-api.service[61839]: Connection: close Apr 14 11:05:24 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:05:24 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:05:24 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:05:24 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:05:24 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:05:24 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTAm6v8qUESI0IjizmIjmsJWXGLOjjeSrv09ri2T6RAbvAYajYyIrxw22PgYPfP-sFhLjBYVsJQMKmp7KoYSOSHZjTqklYHtEK1WW90dx3jL-AC6Ab0TV_VkQ0gzFfhCxphVnwf0RVdI8bvNKr-C_80J359JrotPIMB_M0XXXvYIzcQ Apr 14 11:05:24 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:05:24 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:05:24 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:05:24 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:05:24 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:05:24 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:05:24 user devstack@n-api.service[61839]: X-Project-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:24 user devstack@n-api.service[61839]: X-Project-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:24 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:05:24 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:05:24 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}] Apr 14 11:05:24 user devstack@n-api.service[61839]: X-Tenant: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:24 user devstack@n-api.service[61839]: X-Tenant-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:24 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:24 user devstack@n-api.service[61839]: X-User: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:24 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:05:24 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:05:24 user devstack@n-api.service[61839]: X-User-Id: 78adbbdcd10e446daddde754e46309b2 Apr 14 11:05:24 user devstack@n-api.service[61839]: X-User-Name: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:24 user devstack@n-api.service[61839]: method: > Apr 14 11:05:24 user devstack@n-api.service[61839]: exception: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. Apr 14 11:05:24 user devstack@n-api.service[61839]: action_args: {'id': 'b96e2a1a-8c1b-4189-86b9-a3c1761a9813'} Apr 14 11:05:24 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. Apr 14 11:05:24 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:24 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-ffab44bf-4c55-466b-b67b-bef7b336eecc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Returning 404 to user: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:05:24 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-ffab44bf-4c55-466b-b67b-bef7b336eecc tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813" status: 404 len: 111 microversion: 2.1 time: 0.038176 Apr 14 11:05:24 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 325/982] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:05:24 2023] GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:05:24 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-4fcc404d-d3be-4c5d-8325-3b07cd94d3c2 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '.version_select at 0x7fcd1d081ab0>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:24 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:05:24 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:05:24 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-4fcc404d-d3be-4c5d-8325-3b07cd94d3c2 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1834404942" status: 202 len: 0 microversion: 2.1 time: 0.025567 Apr 14 11:05:24 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 330/983] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 11:05:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1834404942 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:05:28 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:05:28 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=8 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:05:28 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d97f811c-dfb3-449f-9e6c-7ac6a60c1d0c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:28 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-d97f811c-dfb3-449f-9e6c-7ac6a60c1d0c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d97f811c-dfb3-449f-9e6c-7ac6a60c1d0c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d97f811c-dfb3-449f-9e6c-7ac6a60c1d0c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d97f811c-dfb3-449f-9e6c-7ac6a60c1d0c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d97f811c-dfb3-449f-9e6c-7ac6a60c1d0c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d97f811c-dfb3-449f-9e6c-7ac6a60c1d0c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:28 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d97f811c-dfb3-449f-9e6c-7ac6a60c1d0c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:28 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-d97f811c-dfb3-449f-9e6c-7ac6a60c1d0c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HTTP exception thrown: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. Apr 14 11:05:28 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d97f811c-dfb3-449f-9e6c-7ac6a60c1d0c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Request method failure captured: Apr 14 11:05:28 user devstack@n-api.service[61840]: request: DELETE /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813 HTTP/1.1 Apr 14 11:05:28 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:05:28 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:05:28 user devstack@n-api.service[61840]: Connection: close Apr 14 11:05:28 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:05:28 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:05:28 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:05:28 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:05:28 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:05:28 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTAm6v8qUESI0IjizmIjmsJWXGLOjjeSrv09ri2T6RAbvAYajYyIrxw22PgYPfP-sFhLjBYVsJQMKmp7KoYSOSHZjTqklYHtEK1WW90dx3jL-AC6Ab0TV_VkQ0gzFfhCxphVnwf0RVdI8bvNKr-C_80J359JrotPIMB_M0XXXvYIzcQ Apr 14 11:05:28 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:05:28 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:05:28 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:05:28 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:05:28 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:05:28 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:05:28 user devstack@n-api.service[61840]: X-Project-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:28 user devstack@n-api.service[61840]: X-Project-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:28 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:05:28 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:05:28 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}] Apr 14 11:05:28 user devstack@n-api.service[61840]: X-Tenant: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:28 user devstack@n-api.service[61840]: X-Tenant-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:28 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:28 user devstack@n-api.service[61840]: X-User: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:28 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:05:28 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:05:28 user devstack@n-api.service[61840]: X-User-Id: 78adbbdcd10e446daddde754e46309b2 Apr 14 11:05:28 user devstack@n-api.service[61840]: X-User-Name: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:28 user devstack@n-api.service[61840]: method: > Apr 14 11:05:28 user devstack@n-api.service[61840]: exception: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. Apr 14 11:05:28 user devstack@n-api.service[61840]: action_args: {'id': 'b96e2a1a-8c1b-4189-86b9-a3c1761a9813'} Apr 14 11:05:28 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. Apr 14 11:05:28 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:05:28 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d97f811c-dfb3-449f-9e6c-7ac6a60c1d0c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Returning 404 to user: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:05:28 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d97f811c-dfb3-449f-9e6c-7ac6a60c1d0c tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813" status: 404 len: 111 microversion: 2.1 time: 0.045064 Apr 14 11:05:28 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 329/984] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:05:28 2023] DELETE /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:05:28 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-26ac03d0-327d-4329-8f40-cb9cfc68c850 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:28 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-26ac03d0-327d-4329-8f40-cb9cfc68c850 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:28 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26ac03d0-327d-4329-8f40-cb9cfc68c850 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:28 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26ac03d0-327d-4329-8f40-cb9cfc68c850 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:28 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26ac03d0-327d-4329-8f40-cb9cfc68c850 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:28 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26ac03d0-327d-4329-8f40-cb9cfc68c850 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:28 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26ac03d0-327d-4329-8f40-cb9cfc68c850 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:28 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26ac03d0-327d-4329-8f40-cb9cfc68c850 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:28 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-26ac03d0-327d-4329-8f40-cb9cfc68c850 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HTTP exception thrown: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. Apr 14 11:05:28 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-26ac03d0-327d-4329-8f40-cb9cfc68c850 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Request method failure captured: Apr 14 11:05:28 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813 HTTP/1.1 Apr 14 11:05:28 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:05:28 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:05:28 user devstack@n-api.service[61839]: Connection: close Apr 14 11:05:28 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:05:28 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:05:28 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:05:28 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:05:28 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:05:28 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTAm6v8qUESI0IjizmIjmsJWXGLOjjeSrv09ri2T6RAbvAYajYyIrxw22PgYPfP-sFhLjBYVsJQMKmp7KoYSOSHZjTqklYHtEK1WW90dx3jL-AC6Ab0TV_VkQ0gzFfhCxphVnwf0RVdI8bvNKr-C_80J359JrotPIMB_M0XXXvYIzcQ Apr 14 11:05:28 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:05:28 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:05:28 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:05:28 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:05:28 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:05:28 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:05:28 user devstack@n-api.service[61839]: X-Project-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:28 user devstack@n-api.service[61839]: X-Project-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:28 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:05:28 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:05:28 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}] Apr 14 11:05:28 user devstack@n-api.service[61839]: X-Tenant: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:28 user devstack@n-api.service[61839]: X-Tenant-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:28 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:28 user devstack@n-api.service[61839]: X-User: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:28 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:05:28 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:05:28 user devstack@n-api.service[61839]: X-User-Id: 78adbbdcd10e446daddde754e46309b2 Apr 14 11:05:28 user devstack@n-api.service[61839]: X-User-Name: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:28 user devstack@n-api.service[61839]: method: > Apr 14 11:05:28 user devstack@n-api.service[61839]: exception: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. Apr 14 11:05:28 user devstack@n-api.service[61839]: action_args: {'id': 'b96e2a1a-8c1b-4189-86b9-a3c1761a9813'} Apr 14 11:05:28 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. Apr 14 11:05:28 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:28 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-26ac03d0-327d-4329-8f40-cb9cfc68c850 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Returning 404 to user: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:05:28 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-26ac03d0-327d-4329-8f40-cb9cfc68c850 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813" status: 404 len: 111 microversion: 2.1 time: 0.037373 Apr 14 11:05:28 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 326/985] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:05:28 2023] GET /compute/v2.1/servers/b96e2a1a-8c1b-4189-86b9-a3c1761a9813 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-dc599d37-1d02-41b5-ac6b-a681411084ba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-dc599d37-1d02-41b5-ac6b-a681411084ba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-dc599d37-1d02-41b5-ac6b-a681411084ba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-dc599d37-1d02-41b5-ac6b-a681411084ba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-dc599d37-1d02-41b5-ac6b-a681411084ba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-dc599d37-1d02-41b5-ac6b-a681411084ba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-dc599d37-1d02-41b5-ac6b-a681411084ba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-dc599d37-1d02-41b5-ac6b-a681411084ba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:32 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-dc599d37-1d02-41b5-ac6b-a681411084ba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HTTP exception thrown: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-dc599d37-1d02-41b5-ac6b-a681411084ba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Request method failure captured: Apr 14 11:05:32 user devstack@n-api.service[61841]: request: DELETE /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94 HTTP/1.1 Apr 14 11:05:32 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:05:32 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:05:32 user devstack@n-api.service[61841]: Connection: close Apr 14 11:05:32 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:05:32 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:05:32 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:05:32 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:05:32 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOTAm6v8qUESI0IjizmIjmsJWXGLOjjeSrv09ri2T6RAbvAYajYyIrxw22PgYPfP-sFhLjBYVsJQMKmp7KoYSOSHZjTqklYHtEK1WW90dx3jL-AC6Ab0TV_VkQ0gzFfhCxphVnwf0RVdI8bvNKr-C_80J359JrotPIMB_M0XXXvYIzcQ Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Project-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Project-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}] Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Tenant: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Tenant-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:32 user devstack@n-api.service[61841]: X-User: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:32 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:05:32 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:05:32 user devstack@n-api.service[61841]: X-User-Id: 78adbbdcd10e446daddde754e46309b2 Apr 14 11:05:32 user devstack@n-api.service[61841]: X-User-Name: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:32 user devstack@n-api.service[61841]: method: > Apr 14 11:05:32 user devstack@n-api.service[61841]: exception: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61841]: action_args: {'id': 'ef413492-c781-459e-b99c-46a530034c94'} Apr 14 11:05:32 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-dc599d37-1d02-41b5-ac6b-a681411084ba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Returning 404 to user: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:05:32 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-dc599d37-1d02-41b5-ac6b-a681411084ba tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94" status: 404 len: 111 microversion: 2.1 time: 0.037864 Apr 14 11:05:32 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 331/986] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:05:32 2023] DELETE /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:05:32 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-7b73fb62-4ed3-485f-95d8-b4a32b419fb0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:32 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-7b73fb62-4ed3-485f-95d8-b4a32b419fb0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7b73fb62-4ed3-485f-95d8-b4a32b419fb0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7b73fb62-4ed3-485f-95d8-b4a32b419fb0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7b73fb62-4ed3-485f-95d8-b4a32b419fb0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7b73fb62-4ed3-485f-95d8-b4a32b419fb0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7b73fb62-4ed3-485f-95d8-b4a32b419fb0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-7b73fb62-4ed3-485f-95d8-b4a32b419fb0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-7b73fb62-4ed3-485f-95d8-b4a32b419fb0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HTTP exception thrown: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-7b73fb62-4ed3-485f-95d8-b4a32b419fb0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Request method failure captured: Apr 14 11:05:32 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94 HTTP/1.1 Apr 14 11:05:32 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:05:32 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:05:32 user devstack@n-api.service[61840]: Connection: close Apr 14 11:05:32 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:05:32 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:05:32 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:05:32 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:05:32 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:05:32 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTAm6v8qUESI0IjizmIjmsJWXGLOjjeSrv09ri2T6RAbvAYajYyIrxw22PgYPfP-sFhLjBYVsJQMKmp7KoYSOSHZjTqklYHtEK1WW90dx3jL-AC6Ab0TV_VkQ0gzFfhCxphVnwf0RVdI8bvNKr-C_80J359JrotPIMB_M0XXXvYIzcQ Apr 14 11:05:32 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:05:32 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:05:32 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:05:32 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:05:32 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:05:32 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:05:32 user devstack@n-api.service[61840]: X-Project-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:32 user devstack@n-api.service[61840]: X-Project-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:32 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:05:32 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:05:32 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}] Apr 14 11:05:32 user devstack@n-api.service[61840]: X-Tenant: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:32 user devstack@n-api.service[61840]: X-Tenant-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:32 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:32 user devstack@n-api.service[61840]: X-User: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:32 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:05:32 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:05:32 user devstack@n-api.service[61840]: X-User-Id: 78adbbdcd10e446daddde754e46309b2 Apr 14 11:05:32 user devstack@n-api.service[61840]: X-User-Name: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:32 user devstack@n-api.service[61840]: method: > Apr 14 11:05:32 user devstack@n-api.service[61840]: exception: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61840]: action_args: {'id': 'ef413492-c781-459e-b99c-46a530034c94'} Apr 14 11:05:32 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-7b73fb62-4ed3-485f-95d8-b4a32b419fb0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Returning 404 to user: Instance ef413492-c781-459e-b99c-46a530034c94 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:05:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-7b73fb62-4ed3-485f-95d8-b4a32b419fb0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94" status: 404 len: 111 microversion: 2.1 time: 0.030573 Apr 14 11:05:32 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 330/987] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:05:32 2023] GET /compute/v2.1/servers/ef413492-c781-459e-b99c-46a530034c94 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:05:32 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-0acf4af3-abc9-4ddd-a421-cfe7561055c0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:32 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-0acf4af3-abc9-4ddd-a421-cfe7561055c0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0acf4af3-abc9-4ddd-a421-cfe7561055c0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0acf4af3-abc9-4ddd-a421-cfe7561055c0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0acf4af3-abc9-4ddd-a421-cfe7561055c0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0acf4af3-abc9-4ddd-a421-cfe7561055c0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0acf4af3-abc9-4ddd-a421-cfe7561055c0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0acf4af3-abc9-4ddd-a421-cfe7561055c0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:32 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-0acf4af3-abc9-4ddd-a421-cfe7561055c0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HTTP exception thrown: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-0acf4af3-abc9-4ddd-a421-cfe7561055c0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Request method failure captured: Apr 14 11:05:32 user devstack@n-api.service[61839]: request: DELETE /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22 HTTP/1.1 Apr 14 11:05:32 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:05:32 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:05:32 user devstack@n-api.service[61839]: Connection: close Apr 14 11:05:32 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:05:32 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:05:32 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:05:32 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:05:32 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:05:32 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTAm6v8qUESI0IjizmIjmsJWXGLOjjeSrv09ri2T6RAbvAYajYyIrxw22PgYPfP-sFhLjBYVsJQMKmp7KoYSOSHZjTqklYHtEK1WW90dx3jL-AC6Ab0TV_VkQ0gzFfhCxphVnwf0RVdI8bvNKr-C_80J359JrotPIMB_M0XXXvYIzcQ Apr 14 11:05:32 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:05:32 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:05:32 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:05:32 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:05:32 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:05:32 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:05:32 user devstack@n-api.service[61839]: X-Project-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:32 user devstack@n-api.service[61839]: X-Project-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:32 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:05:32 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:05:32 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}] Apr 14 11:05:32 user devstack@n-api.service[61839]: X-Tenant: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:32 user devstack@n-api.service[61839]: X-Tenant-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:32 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:32 user devstack@n-api.service[61839]: X-User: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:32 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:05:32 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:05:32 user devstack@n-api.service[61839]: X-User-Id: 78adbbdcd10e446daddde754e46309b2 Apr 14 11:05:32 user devstack@n-api.service[61839]: X-User-Name: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:32 user devstack@n-api.service[61839]: method: > Apr 14 11:05:32 user devstack@n-api.service[61839]: exception: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61839]: action_args: {'id': '3393be13-7d81-48da-b6dd-a427e8403b22'} Apr 14 11:05:32 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-0acf4af3-abc9-4ddd-a421-cfe7561055c0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Returning 404 to user: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:05:32 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-0acf4af3-abc9-4ddd-a421-cfe7561055c0 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22" status: 404 len: 111 microversion: 2.1 time: 0.034356 Apr 14 11:05:32 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 327/988] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:05:32 2023] DELETE /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-63ee561d-2868-416a-a0f0-33302779e359 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-63ee561d-2868-416a-a0f0-33302779e359 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-63ee561d-2868-416a-a0f0-33302779e359 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-63ee561d-2868-416a-a0f0-33302779e359 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-63ee561d-2868-416a-a0f0-33302779e359 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-63ee561d-2868-416a-a0f0-33302779e359 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-63ee561d-2868-416a-a0f0-33302779e359 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-63ee561d-2868-416a-a0f0-33302779e359 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:32 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-63ee561d-2868-416a-a0f0-33302779e359 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HTTP exception thrown: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-63ee561d-2868-416a-a0f0-33302779e359 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Request method failure captured: Apr 14 11:05:32 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22 HTTP/1.1 Apr 14 11:05:32 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:05:32 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:05:32 user devstack@n-api.service[61841]: Connection: close Apr 14 11:05:32 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:05:32 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:05:32 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:05:32 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:05:32 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOTAm6v8qUESI0IjizmIjmsJWXGLOjjeSrv09ri2T6RAbvAYajYyIrxw22PgYPfP-sFhLjBYVsJQMKmp7KoYSOSHZjTqklYHtEK1WW90dx3jL-AC6Ab0TV_VkQ0gzFfhCxphVnwf0RVdI8bvNKr-C_80J359JrotPIMB_M0XXXvYIzcQ Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Project-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Project-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}] Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Tenant: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Tenant-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:32 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:32 user devstack@n-api.service[61841]: X-User: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:32 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:05:32 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:05:32 user devstack@n-api.service[61841]: X-User-Id: 78adbbdcd10e446daddde754e46309b2 Apr 14 11:05:32 user devstack@n-api.service[61841]: X-User-Name: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:32 user devstack@n-api.service[61841]: method: > Apr 14 11:05:32 user devstack@n-api.service[61841]: exception: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61841]: action_args: {'id': '3393be13-7d81-48da-b6dd-a427e8403b22'} Apr 14 11:05:32 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. Apr 14 11:05:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:05:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-63ee561d-2868-416a-a0f0-33302779e359 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Returning 404 to user: Instance 3393be13-7d81-48da-b6dd-a427e8403b22 could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:05:32 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-63ee561d-2868-416a-a0f0-33302779e359 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22" status: 404 len: 111 microversion: 2.1 time: 0.033929 Apr 14 11:05:32 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 332/989] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:05:32 2023] GET /compute/v2.1/servers/3393be13-7d81-48da-b6dd-a427e8403b22 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:05:35 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-43be52d1-cf1d-404e-8743-8c1d6c1ffe5d tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:35 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-43be52d1-cf1d-404e-8743-8c1d6c1ffe5d tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-43be52d1-cf1d-404e-8743-8c1d6c1ffe5d tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-43be52d1-cf1d-404e-8743-8c1d6c1ffe5d tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-43be52d1-cf1d-404e-8743-8c1d6c1ffe5d tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-43be52d1-cf1d-404e-8743-8c1d6c1ffe5d tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-43be52d1-cf1d-404e-8743-8c1d6c1ffe5d tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-43be52d1-cf1d-404e-8743-8c1d6c1ffe5d tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:35 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-43be52d1-cf1d-404e-8743-8c1d6c1ffe5d tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HTTP exception thrown: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. Apr 14 11:05:35 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-43be52d1-cf1d-404e-8743-8c1d6c1ffe5d tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Request method failure captured: Apr 14 11:05:35 user devstack@n-api.service[61840]: request: DELETE /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb HTTP/1.1 Apr 14 11:05:35 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:05:35 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:05:35 user devstack@n-api.service[61840]: Connection: close Apr 14 11:05:35 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:05:35 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:05:35 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:05:35 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:05:35 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:05:35 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTAm6v8qUESI0IjizmIjmsJWXGLOjjeSrv09ri2T6RAbvAYajYyIrxw22PgYPfP-sFhLjBYVsJQMKmp7KoYSOSHZjTqklYHtEK1WW90dx3jL-AC6Ab0TV_VkQ0gzFfhCxphVnwf0RVdI8bvNKr-C_80J359JrotPIMB_M0XXXvYIzcQ Apr 14 11:05:35 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:05:35 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:05:35 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:05:35 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:05:35 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:05:35 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:05:35 user devstack@n-api.service[61840]: X-Project-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:35 user devstack@n-api.service[61840]: X-Project-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:35 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:05:35 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:05:35 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}] Apr 14 11:05:35 user devstack@n-api.service[61840]: X-Tenant: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:35 user devstack@n-api.service[61840]: X-Tenant-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:35 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:35 user devstack@n-api.service[61840]: X-User: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:35 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:05:35 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:05:35 user devstack@n-api.service[61840]: X-User-Id: 78adbbdcd10e446daddde754e46309b2 Apr 14 11:05:35 user devstack@n-api.service[61840]: X-User-Name: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:35 user devstack@n-api.service[61840]: method: > Apr 14 11:05:35 user devstack@n-api.service[61840]: exception: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. Apr 14 11:05:35 user devstack@n-api.service[61840]: action_args: {'id': 'cd661ae0-c4bb-4117-847d-ef7e85d062fb'} Apr 14 11:05:35 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. Apr 14 11:05:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:05:35 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-43be52d1-cf1d-404e-8743-8c1d6c1ffe5d tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Returning 404 to user: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:05:35 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-43be52d1-cf1d-404e-8743-8c1d6c1ffe5d tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb" status: 404 len: 111 microversion: 2.1 time: 0.040505 Apr 14 11:05:35 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 331/990] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:05:35 2023] DELETE /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:05:35 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-d208b71e-1692-4bb3-84b0-a47264e5c5ee tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:35 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-d208b71e-1692-4bb3-84b0-a47264e5c5ee tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d208b71e-1692-4bb3-84b0-a47264e5c5ee tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d208b71e-1692-4bb3-84b0-a47264e5c5ee tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d208b71e-1692-4bb3-84b0-a47264e5c5ee tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d208b71e-1692-4bb3-84b0-a47264e5c5ee tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d208b71e-1692-4bb3-84b0-a47264e5c5ee tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-d208b71e-1692-4bb3-84b0-a47264e5c5ee tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:35 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-d208b71e-1692-4bb3-84b0-a47264e5c5ee tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HTTP exception thrown: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. Apr 14 11:05:35 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-d208b71e-1692-4bb3-84b0-a47264e5c5ee tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Request method failure captured: Apr 14 11:05:35 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb HTTP/1.1 Apr 14 11:05:35 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:05:35 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:05:35 user devstack@n-api.service[61839]: Connection: close Apr 14 11:05:35 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:05:35 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:05:35 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:05:35 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:05:35 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:05:35 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTAm6v8qUESI0IjizmIjmsJWXGLOjjeSrv09ri2T6RAbvAYajYyIrxw22PgYPfP-sFhLjBYVsJQMKmp7KoYSOSHZjTqklYHtEK1WW90dx3jL-AC6Ab0TV_VkQ0gzFfhCxphVnwf0RVdI8bvNKr-C_80J359JrotPIMB_M0XXXvYIzcQ Apr 14 11:05:35 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:05:35 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:05:35 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:05:35 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:05:35 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:05:35 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:05:35 user devstack@n-api.service[61839]: X-Project-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:35 user devstack@n-api.service[61839]: X-Project-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:35 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:05:35 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:05:35 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cb8f294f957f4c74ae959c1e9f238427"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cb8f294f957f4c74ae959c1e9f238427"}]}] Apr 14 11:05:35 user devstack@n-api.service[61839]: X-Tenant: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:35 user devstack@n-api.service[61839]: X-Tenant-Id: cb8f294f957f4c74ae959c1e9f238427 Apr 14 11:05:35 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-531644967 Apr 14 11:05:35 user devstack@n-api.service[61839]: X-User: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:35 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:05:35 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:05:35 user devstack@n-api.service[61839]: X-User-Id: 78adbbdcd10e446daddde754e46309b2 Apr 14 11:05:35 user devstack@n-api.service[61839]: X-User-Name: tempest-AttachVolumeNegativeTest-531644967-project-member Apr 14 11:05:35 user devstack@n-api.service[61839]: method: > Apr 14 11:05:35 user devstack@n-api.service[61839]: exception: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. Apr 14 11:05:35 user devstack@n-api.service[61839]: action_args: {'id': 'cd661ae0-c4bb-4117-847d-ef7e85d062fb'} Apr 14 11:05:35 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. Apr 14 11:05:35 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:35 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-d208b71e-1692-4bb3-84b0-a47264e5c5ee tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Returning 404 to user: Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:05:35 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-d208b71e-1692-4bb3-84b0-a47264e5c5ee tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb" status: 404 len: 111 microversion: 2.1 time: 0.049698 Apr 14 11:05:35 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 328/991] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:05:35 2023] GET /compute/v2.1/servers/cd661ae0-c4bb-4117-847d-ef7e85d062fb => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:05:44 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:44 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:44 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:05:44 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:05:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:44 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:05:44 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e" status: 204 len: 0 microversion: 2.1 time: 0.137348 Apr 14 11:05:44 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 333/992] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:05:44 2023] DELETE /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:05:44 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-95b1b2b0-0edd-45ad-90b9-3758f2d13ceb tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:44 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-95b1b2b0-0edd-45ad-90b9-3758f2d13ceb tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-95b1b2b0-0edd-45ad-90b9-3758f2d13ceb tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-95b1b2b0-0edd-45ad-90b9-3758f2d13ceb tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-95b1b2b0-0edd-45ad-90b9-3758f2d13ceb tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-95b1b2b0-0edd-45ad-90b9-3758f2d13ceb tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-95b1b2b0-0edd-45ad-90b9-3758f2d13ceb tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-95b1b2b0-0edd-45ad-90b9-3758f2d13ceb tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:44 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-95b1b2b0-0edd-45ad-90b9-3758f2d13ceb tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:05:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-95b1b2b0-0edd-45ad-90b9-3758f2d13ceb tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e" status: 200 len: 1553 microversion: 2.1 time: 0.255184 Apr 14 11:05:44 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 332/993] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:05:44 2023] GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e => generated 1553 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:05:45 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-d0bca87e-a370-4eae-93d3-2d5ee3603da3 req-5305170e-fdbe-4c29-801f-58350c904a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db2e71c-939b-4d2f-b1be-c2122f7cd73e", "name": "network-vif-unplugged", "status": "completed", "tag": "1e547ec7-7efd-480f-84be-806c8cf25b90"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:05:45 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-d0bca87e-a370-4eae-93d3-2d5ee3603da3 req-5305170e-fdbe-4c29-801f-58350c904a3e service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:45 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-d0bca87e-a370-4eae-93d3-2d5ee3603da3 req-5305170e-fdbe-4c29-801f-58350c904a3e service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:45 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-d0bca87e-a370-4eae-93d3-2d5ee3603da3 req-5305170e-fdbe-4c29-801f-58350c904a3e service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:45 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-d0bca87e-a370-4eae-93d3-2d5ee3603da3 req-5305170e-fdbe-4c29-801f-58350c904a3e service nova] Creating event network-vif-unplugged:1e547ec7-7efd-480f-84be-806c8cf25b90 for instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e on user Apr 14 11:05:45 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-d0bca87e-a370-4eae-93d3-2d5ee3603da3 req-5305170e-fdbe-4c29-801f-58350c904a3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038948 Apr 14 11:05:45 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 329/994] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:05:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:05:46 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-b4495c4c-0391-4623-b350-ff8e4b842581 req-14219276-bfd9-44e4-bd16-50a168f928b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db2e71c-939b-4d2f-b1be-c2122f7cd73e", "name": "network-vif-deleted", "tag": "1e547ec7-7efd-480f-84be-806c8cf25b90"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:05:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b4495c4c-0391-4623-b350-ff8e4b842581 req-14219276-bfd9-44e4-bd16-50a168f928b9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b4495c4c-0391-4623-b350-ff8e4b842581 req-14219276-bfd9-44e4-bd16-50a168f928b9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:46 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b4495c4c-0391-4623-b350-ff8e4b842581 req-14219276-bfd9-44e4-bd16-50a168f928b9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:46 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-b4495c4c-0391-4623-b350-ff8e4b842581 req-14219276-bfd9-44e4-bd16-50a168f928b9 service nova] Creating event network-vif-deleted:1e547ec7-7efd-480f-84be-806c8cf25b90 for instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e on user Apr 14 11:05:46 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-b4495c4c-0391-4623-b350-ff8e4b842581 req-14219276-bfd9-44e4-bd16-50a168f928b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035877 Apr 14 11:05:46 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 333/995] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:05:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:05:47 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-bba22d4b-85e7-4adb-8356-1b9322835cc0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:47 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-bba22d4b-85e7-4adb-8356-1b9322835cc0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bba22d4b-85e7-4adb-8356-1b9322835cc0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bba22d4b-85e7-4adb-8356-1b9322835cc0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bba22d4b-85e7-4adb-8356-1b9322835cc0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bba22d4b-85e7-4adb-8356-1b9322835cc0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bba22d4b-85e7-4adb-8356-1b9322835cc0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:47 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-bba22d4b-85e7-4adb-8356-1b9322835cc0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:47 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-bba22d4b-85e7-4adb-8356-1b9322835cc0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.319376 Apr 14 11:05:47 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 334/996] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:05:46 2023] GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/os-volume_attachments => generated 25 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 11:05:47 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-71f64b2d-bbc4-44a0-b5d2-af891a25bafd tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:47 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-71f64b2d-bbc4-44a0-b5d2-af891a25bafd tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-71f64b2d-bbc4-44a0-b5d2-af891a25bafd tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-71f64b2d-bbc4-44a0-b5d2-af891a25bafd tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-71f64b2d-bbc4-44a0-b5d2-af891a25bafd tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-71f64b2d-bbc4-44a0-b5d2-af891a25bafd tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-71f64b2d-bbc4-44a0-b5d2-af891a25bafd tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:47 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-71f64b2d-bbc4-44a0-b5d2-af891a25bafd tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:47 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-49817dd9-5ef2-41d4-ba58-02baa9a57d76 req-882b44b9-add8-4a16-836d-ceb9dc21a241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db2e71c-939b-4d2f-b1be-c2122f7cd73e", "name": "network-vif-plugged", "status": "completed", "tag": "1e547ec7-7efd-480f-84be-806c8cf25b90"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:05:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-49817dd9-5ef2-41d4-ba58-02baa9a57d76 req-882b44b9-add8-4a16-836d-ceb9dc21a241 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-49817dd9-5ef2-41d4-ba58-02baa9a57d76 req-882b44b9-add8-4a16-836d-ceb9dc21a241 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-49817dd9-5ef2-41d4-ba58-02baa9a57d76 req-882b44b9-add8-4a16-836d-ceb9dc21a241 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:47 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-49817dd9-5ef2-41d4-ba58-02baa9a57d76 req-882b44b9-add8-4a16-836d-ceb9dc21a241 service nova] Creating event network-vif-plugged:1e547ec7-7efd-480f-84be-806c8cf25b90 for instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e on user Apr 14 11:05:47 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-49817dd9-5ef2-41d4-ba58-02baa9a57d76 req-882b44b9-add8-4a16-836d-ceb9dc21a241 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035208 Apr 14 11:05:47 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 334/997] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:05:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:05:47 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-71f64b2d-bbc4-44a0-b5d2-af891a25bafd tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] HTTP exception thrown: Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 is not attached to volume 0da1ed17-2b8c-4dd3-a61a-1133a9420d21 Apr 14 11:05:47 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-71f64b2d-bbc4-44a0-b5d2-af891a25bafd tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Request method failure captured: Apr 14 11:05:47 user devstack@n-api.service[61839]: request: DELETE /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/os-volume_attachments/0da1ed17-2b8c-4dd3-a61a-1133a9420d21 HTTP/1.1 Apr 14 11:05:47 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:05:47 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:05:47 user devstack@n-api.service[61839]: Connection: close Apr 14 11:05:47 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:05:47 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:05:47 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:05:47 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:05:47 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:05:47 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTJW_nWg2J6o5vRSemm_jlYLT0-S7Yb4P258bLmZ_oKhu6WwoM645orauyJVaZxPKqfOe3071SM1yQhGISaiJoewlLZV_YCsGerTXcSPWKP8ETj9kSKFH3ym18ac0vy24ipdNhiqubWRNnQNGdXbdJml0bR5LRKX7PzbHlt-bdy21fA Apr 14 11:05:47 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:05:47 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:05:47 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:05:47 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:05:47 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:05:47 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:05:47 user devstack@n-api.service[61839]: X-Project-Id: 5809862340a84c83a772c65c77513608 Apr 14 11:05:47 user devstack@n-api.service[61839]: X-Project-Name: tempest-TestMinimumBasicScenario-2127394977 Apr 14 11:05:47 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:05:47 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:05:47 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5809862340a84c83a772c65c77513608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5809862340a84c83a772c65c77513608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5809862340a84c83a772c65c77513608"}]}] Apr 14 11:05:47 user devstack@n-api.service[61839]: X-Tenant: tempest-TestMinimumBasicScenario-2127394977 Apr 14 11:05:47 user devstack@n-api.service[61839]: X-Tenant-Id: 5809862340a84c83a772c65c77513608 Apr 14 11:05:47 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2127394977 Apr 14 11:05:47 user devstack@n-api.service[61839]: X-User: tempest-TestMinimumBasicScenario-2127394977-project-member Apr 14 11:05:47 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:05:47 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:05:47 user devstack@n-api.service[61839]: X-User-Id: 831215baa8fd4fe7ba65193bbbdad1b4 Apr 14 11:05:47 user devstack@n-api.service[61839]: X-User-Name: tempest-TestMinimumBasicScenario-2127394977-project-member Apr 14 11:05:47 user devstack@n-api.service[61839]: method: > Apr 14 11:05:47 user devstack@n-api.service[61839]: exception: Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 is not attached to volume 0da1ed17-2b8c-4dd3-a61a-1133a9420d21 Apr 14 11:05:47 user devstack@n-api.service[61839]: action_args: {'server_id': '9c4cc2a1-0c54-4f20-b33f-9085af7b10a3', 'id': '0da1ed17-2b8c-4dd3-a61a-1133a9420d21'} Apr 14 11:05:47 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0da1ed17-2b8c-4dd3-a61a-1133a9420d21. Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 is not attached to volume 0da1ed17-2b8c-4dd3-a61a-1133a9420d21 Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 is not attached to volume 0da1ed17-2b8c-4dd3-a61a-1133a9420d21 Apr 14 11:05:47 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:05:47 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-71f64b2d-bbc4-44a0-b5d2-af891a25bafd tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Returning 404 to user: Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 is not attached to volume 0da1ed17-2b8c-4dd3-a61a-1133a9420d21 {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:05:47 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-71f64b2d-bbc4-44a0-b5d2-af891a25bafd tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/os-volume_attachments/0da1ed17-2b8c-4dd3-a61a-1133a9420d21" status: 404 len: 154 microversion: 2.1 time: 0.107663 Apr 14 11:05:47 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 330/998] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 11:05:47 2023] DELETE /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/os-volume_attachments/0da1ed17-2b8c-4dd3-a61a-1133a9420d21 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:05:50 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:50 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:50 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:05:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" status: 204 len: 0 microversion: 2.1 time: 0.150444 Apr 14 11:05:50 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 335/999] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:05:50 2023] DELETE /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:05:50 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-0b4a1e4c-9f89-44a7-a5e5-f113106743a0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:05:50 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-0b4a1e4c-9f89-44a7-a5e5-f113106743a0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:05:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0b4a1e4c-9f89-44a7-a5e5-f113106743a0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0b4a1e4c-9f89-44a7-a5e5-f113106743a0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0b4a1e4c-9f89-44a7-a5e5-f113106743a0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0b4a1e4c-9f89-44a7-a5e5-f113106743a0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0b4a1e4c-9f89-44a7-a5e5-f113106743a0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0b4a1e4c-9f89-44a7-a5e5-f113106743a0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:50 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-0b4a1e4c-9f89-44a7-a5e5-f113106743a0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:05:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-0b4a1e4c-9f89-44a7-a5e5-f113106743a0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" status: 200 len: 1541 microversion: 2.1 time: 0.191313 Apr 14 11:05:50 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 335/1000] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:05:50 2023] GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => generated 1541 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:05:51 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-9814b48d-f6d8-47c0-897a-9fbeb1c34e36 req-54f082c3-6de3-45b4-a55f-6c52185a4630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "name": "network-vif-unplugged", "status": "completed", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:05:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9814b48d-f6d8-47c0-897a-9fbeb1c34e36 req-54f082c3-6de3-45b4-a55f-6c52185a4630 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9814b48d-f6d8-47c0-897a-9fbeb1c34e36 req-54f082c3-6de3-45b4-a55f-6c52185a4630 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:51 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-9814b48d-f6d8-47c0-897a-9fbeb1c34e36 req-54f082c3-6de3-45b4-a55f-6c52185a4630 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:51 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-9814b48d-f6d8-47c0-897a-9fbeb1c34e36 req-54f082c3-6de3-45b4-a55f-6c52185a4630 service nova] Creating event network-vif-unplugged:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:05:51 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-9814b48d-f6d8-47c0-897a-9fbeb1c34e36 req-54f082c3-6de3-45b4-a55f-6c52185a4630 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032601 Apr 14 11:05:51 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 331/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:05:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:05:52 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-5bbff7b5-b1c8-488d-884c-c63b8929458d req-aec2ad28-f0d1-4d24-b26e-fee74b420e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "name": "network-vif-deleted", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:05:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5bbff7b5-b1c8-488d-884c-c63b8929458d req-aec2ad28-f0d1-4d24-b26e-fee74b420e8a service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5bbff7b5-b1c8-488d-884c-c63b8929458d req-aec2ad28-f0d1-4d24-b26e-fee74b420e8a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:52 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5bbff7b5-b1c8-488d-884c-c63b8929458d req-aec2ad28-f0d1-4d24-b26e-fee74b420e8a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:52 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-5bbff7b5-b1c8-488d-884c-c63b8929458d req-aec2ad28-f0d1-4d24-b26e-fee74b420e8a service nova] Creating event network-vif-deleted:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:05:52 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-5bbff7b5-b1c8-488d-884c-c63b8929458d req-aec2ad28-f0d1-4d24-b26e-fee74b420e8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043440 Apr 14 11:05:52 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 336/1002] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:05:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:05:53 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "name": "network-vif-plugged", "status": "completed", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}, {"server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "name": "network-vif-plugged", "status": "completed", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}, {"server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "name": "network-vif-plugged", "status": "completed", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}, {"server_uuid": "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3", "name": "network-vif-plugged", "status": "completed", "tag": "f41f6957-bf6d-47bf-bb71-638137929e1e"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:05:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:05:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:05:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:05:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Creating event network-vif-plugged:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:05:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Creating event network-vif-plugged:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:05:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Creating event network-vif-plugged:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:05:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Creating event network-vif-plugged:f41f6957-bf6d-47bf-bb71-638137929e1e for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 on user Apr 14 11:05:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.030180 Apr 14 11:05:53 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 336/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:05:53 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:02 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=14 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:02 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=18 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:02 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-407c2306-eb56-4e70-9b72-b192bc4dd426 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:02 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-407c2306-eb56-4e70-9b72-b192bc4dd426 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-407c2306-eb56-4e70-9b72-b192bc4dd426 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-407c2306-eb56-4e70-9b72-b192bc4dd426 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-407c2306-eb56-4e70-9b72-b192bc4dd426 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-407c2306-eb56-4e70-9b72-b192bc4dd426 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-407c2306-eb56-4e70-9b72-b192bc4dd426 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:02 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-407c2306-eb56-4e70-9b72-b192bc4dd426 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:02 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-407c2306-eb56-4e70-9b72-b192bc4dd426 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] HTTP exception thrown: Instance a936fb20-3f17-4114-829a-8659da6bc5f3 could not be found. Apr 14 11:06:02 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-407c2306-eb56-4e70-9b72-b192bc4dd426 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Request method failure captured: Apr 14 11:06:02 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/a936fb20-3f17-4114-829a-8659da6bc5f3 HTTP/1.1 Apr 14 11:06:02 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:06:02 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:06:02 user devstack@n-api.service[61839]: Connection: close Apr 14 11:06:02 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:06:02 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:06:02 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:06:02 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:06:02 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS8E-UO3BI5f7b6x50N3vDY0vRMFs_uZm8-H9vMJmHi_iiDftAa0EnpcQYQbE80P6WQhfxAHEAXNgHj-2f1MRH59Q-QaVTEXSktnZkrjGNxMQhD0V9gm5P_FZkrUUJopC-KIf72jcPzhH7K40SInM3QE33ccY0pw2ZuA-2a78raF9ys Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Project-Id: 71289f80a05141f482cb538dac3d7b38 Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2130542140 Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71289f80a05141f482cb538dac3d7b38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71289f80a05141f482cb538dac3d7b38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71289f80a05141f482cb538dac3d7b38"}]}] Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2130542140 Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Tenant-Id: 71289f80a05141f482cb538dac3d7b38 Apr 14 11:06:02 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2130542140 Apr 14 11:06:02 user devstack@n-api.service[61839]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member Apr 14 11:06:02 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:06:02 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:06:02 user devstack@n-api.service[61839]: X-User-Id: 395bc9d7007c4e01ac7effd418bcea19 Apr 14 11:06:02 user devstack@n-api.service[61839]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member Apr 14 11:06:02 user devstack@n-api.service[61839]: method: > Apr 14 11:06:02 user devstack@n-api.service[61839]: exception: Instance a936fb20-3f17-4114-829a-8659da6bc5f3 could not be found. Apr 14 11:06:02 user devstack@n-api.service[61839]: action_args: {'id': 'a936fb20-3f17-4114-829a-8659da6bc5f3'} Apr 14 11:06:02 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a936fb20-3f17-4114-829a-8659da6bc5f3 could not be found. Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a936fb20-3f17-4114-829a-8659da6bc5f3 could not be found. Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a936fb20-3f17-4114-829a-8659da6bc5f3 could not be found. Apr 14 11:06:02 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:06:02 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-407c2306-eb56-4e70-9b72-b192bc4dd426 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Returning 404 to user: Instance a936fb20-3f17-4114-829a-8659da6bc5f3 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:06:02 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-407c2306-eb56-4e70-9b72-b192bc4dd426 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a936fb20-3f17-4114-829a-8659da6bc5f3" status: 404 len: 111 microversion: 2.87 time: 0.035340 Apr 14 11:06:02 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 332/1004] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:06:02 2023] GET /compute/v2.1/servers/a936fb20-3f17-4114-829a-8659da6bc5f3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 11:06:02 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:02 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:02 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:02 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:02 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:02 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:06:03 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416" status: 204 len: 0 microversion: 2.87 time: 0.138417 Apr 14 11:06:03 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 337/1005] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 11:06:02 2023] DELETE /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-3fb6f664-fd89-4ffe-90d9-48c82ab8138f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-3fb6f664-fd89-4ffe-90d9-48c82ab8138f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=17 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3fb6f664-fd89-4ffe-90d9-48c82ab8138f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3fb6f664-fd89-4ffe-90d9-48c82ab8138f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3fb6f664-fd89-4ffe-90d9-48c82ab8138f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3fb6f664-fd89-4ffe-90d9-48c82ab8138f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3fb6f664-fd89-4ffe-90d9-48c82ab8138f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-3fb6f664-fd89-4ffe-90d9-48c82ab8138f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=25 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-3fb6f664-fd89-4ffe-90d9-48c82ab8138f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-3fb6f664-fd89-4ffe-90d9-48c82ab8138f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-3fb6f664-fd89-4ffe-90d9-48c82ab8138f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:06:03 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-3fb6f664-fd89-4ffe-90d9-48c82ab8138f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416" status: 200 len: 1775 microversion: 2.87 time: 0.183435 Apr 14 11:06:03 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 337/1006] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:06:03 2023] GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416 => generated 1775 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:06:03 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-6ec1d6cd-98f7-4c11-bc8d-7a1ecae8fd1c req-505160d1-3fe8-4b17-a350-2f7384080799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cae9f61-763f-4671-a873-d15f01384416", "name": "network-vif-unplugged", "status": "completed", "tag": "30d57100-3321-41fe-9335-d53c8c5e291c"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-6ec1d6cd-98f7-4c11-bc8d-7a1ecae8fd1c req-505160d1-3fe8-4b17-a350-2f7384080799 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-6ec1d6cd-98f7-4c11-bc8d-7a1ecae8fd1c req-505160d1-3fe8-4b17-a350-2f7384080799 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:03 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-6ec1d6cd-98f7-4c11-bc8d-7a1ecae8fd1c req-505160d1-3fe8-4b17-a350-2f7384080799 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:03 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-6ec1d6cd-98f7-4c11-bc8d-7a1ecae8fd1c req-505160d1-3fe8-4b17-a350-2f7384080799 service nova] Creating event network-vif-unplugged:30d57100-3321-41fe-9335-d53c8c5e291c for instance 6cae9f61-763f-4671-a873-d15f01384416 on user Apr 14 11:06:03 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-6ec1d6cd-98f7-4c11-bc8d-7a1ecae8fd1c req-505160d1-3fe8-4b17-a350-2f7384080799 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028064 Apr 14 11:06:03 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 333/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:03 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:03 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:03 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:03 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:06:03 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/269aa265-9398-4692-8ab4-f3bf5be82714" status: 204 len: 0 microversion: 2.1 time: 0.115425 Apr 14 11:06:03 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 338/1008] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:06:03 2023] DELETE /compute/v2.1/servers/269aa265-9398-4692-8ab4-f3bf5be82714 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-33340c4f-8887-4ea5-8c71-aa1c825daca4 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-33340c4f-8887-4ea5-8c71-aa1c825daca4 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-33340c4f-8887-4ea5-8c71-aa1c825daca4 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-33340c4f-8887-4ea5-8c71-aa1c825daca4 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-33340c4f-8887-4ea5-8c71-aa1c825daca4 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-33340c4f-8887-4ea5-8c71-aa1c825daca4 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-33340c4f-8887-4ea5-8c71-aa1c825daca4 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-33340c4f-8887-4ea5-8c71-aa1c825daca4 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:03 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-33340c4f-8887-4ea5-8c71-aa1c825daca4 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '282af802879e463ea87844b5fc926692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310da753ca94b38a7c660b8613af044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:06:03 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-33340c4f-8887-4ea5-8c71-aa1c825daca4 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/269aa265-9398-4692-8ab4-f3bf5be82714" status: 200 len: 1492 microversion: 2.1 time: 0.207882 Apr 14 11:06:03 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 338/1009] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:06:03 2023] GET /compute/v2.1/servers/269aa265-9398-4692-8ab4-f3bf5be82714 => generated 1492 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:06:05 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-f1291355-face-4f5a-9c56-f7426035b0af req-7499c558-1d6b-40d9-8c31-99be2663045d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269aa265-9398-4692-8ab4-f3bf5be82714", "name": "network-vif-deleted", "tag": "71f5b8c7-15e0-485a-8632-01ed76e9ad91"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f1291355-face-4f5a-9c56-f7426035b0af req-7499c558-1d6b-40d9-8c31-99be2663045d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f1291355-face-4f5a-9c56-f7426035b0af req-7499c558-1d6b-40d9-8c31-99be2663045d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:05 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-f1291355-face-4f5a-9c56-f7426035b0af req-7499c558-1d6b-40d9-8c31-99be2663045d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:05 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-f1291355-face-4f5a-9c56-f7426035b0af req-7499c558-1d6b-40d9-8c31-99be2663045d service nova] Creating event network-vif-deleted:71f5b8c7-15e0-485a-8632-01ed76e9ad91 for instance 269aa265-9398-4692-8ab4-f3bf5be82714 on user Apr 14 11:06:05 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-f1291355-face-4f5a-9c56-f7426035b0af req-7499c558-1d6b-40d9-8c31-99be2663045d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028578 Apr 14 11:06:05 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 334/1010] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:05 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cae9f61-763f-4671-a873-d15f01384416", "name": "network-vif-plugged", "status": "completed", "tag": "30d57100-3321-41fe-9335-d53c8c5e291c"}, {"server_uuid": "269aa265-9398-4692-8ab4-f3bf5be82714", "name": "network-vif-unplugged", "status": "completed", "tag": "71f5b8c7-15e0-485a-8632-01ed76e9ad91"}, {"server_uuid": "269aa265-9398-4692-8ab4-f3bf5be82714", "name": "network-vif-plugged", "status": "completed", "tag": "71f5b8c7-15e0-485a-8632-01ed76e9ad91"}, {"server_uuid": "269aa265-9398-4692-8ab4-f3bf5be82714", "name": "network-vif-plugged", "status": "completed", "tag": "71f5b8c7-15e0-485a-8632-01ed76e9ad91"}, {"server_uuid": "269aa265-9398-4692-8ab4-f3bf5be82714", "name": "network-vif-plugged", "status": "completed", "tag": "71f5b8c7-15e0-485a-8632-01ed76e9ad91"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:05 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Creating event network-vif-plugged:30d57100-3321-41fe-9335-d53c8c5e291c for instance 6cae9f61-763f-4671-a873-d15f01384416 on user Apr 14 11:06:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Creating event network-vif-unplugged:71f5b8c7-15e0-485a-8632-01ed76e9ad91 for instance 269aa265-9398-4692-8ab4-f3bf5be82714 on user Apr 14 11:06:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Creating event network-vif-plugged:71f5b8c7-15e0-485a-8632-01ed76e9ad91 for instance 269aa265-9398-4692-8ab4-f3bf5be82714 on user Apr 14 11:06:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Creating event network-vif-plugged:71f5b8c7-15e0-485a-8632-01ed76e9ad91 for instance 269aa265-9398-4692-8ab4-f3bf5be82714 on user Apr 14 11:06:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Creating event network-vif-plugged:71f5b8c7-15e0-485a-8632-01ed76e9ad91 for instance 269aa265-9398-4692-8ab4-f3bf5be82714 on user Apr 14 11:06:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.036532 Apr 14 11:06:05 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 339/1011] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:05 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:05 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-c1f9247a-56e1-4c3d-836c-7b6261d55900 req-50cae9de-16d5-4f11-96e3-cf12b6736e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cae9f61-763f-4671-a873-d15f01384416", "name": "network-vif-deleted", "tag": "30d57100-3321-41fe-9335-d53c8c5e291c"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:05 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-c1f9247a-56e1-4c3d-836c-7b6261d55900 req-50cae9de-16d5-4f11-96e3-cf12b6736e60 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:05 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-c1f9247a-56e1-4c3d-836c-7b6261d55900 req-50cae9de-16d5-4f11-96e3-cf12b6736e60 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:05 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-c1f9247a-56e1-4c3d-836c-7b6261d55900 req-50cae9de-16d5-4f11-96e3-cf12b6736e60 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:05 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-c1f9247a-56e1-4c3d-836c-7b6261d55900 req-50cae9de-16d5-4f11-96e3-cf12b6736e60 service nova] Creating event network-vif-deleted:30d57100-3321-41fe-9335-d53c8c5e291c for instance 6cae9f61-763f-4671-a873-d15f01384416 on user Apr 14 11:06:05 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-c1f9247a-56e1-4c3d-836c-7b6261d55900 req-50cae9de-16d5-4f11-96e3-cf12b6736e60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033460 Apr 14 11:06:05 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 339/1012] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:34 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:34 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:34 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-985741733", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "24d3b48b-6ea1-489d-add9-81a2f85cc64a", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32"}]}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:34 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] validate_networks() for [('6d6b6b35-b5ef-4d7c-abce-cad21cc99e32', None, None, None, None, None)] {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-1cc017eb-e76e-4d65-85f0-f7a35e3b280d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-1cc017eb-e76e-4d65-85f0-f7a35e3b280d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1cc017eb-e76e-4d65-85f0-f7a35e3b280d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1cc017eb-e76e-4d65-85f0-f7a35e3b280d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1cc017eb-e76e-4d65-85f0-f7a35e3b280d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1cc017eb-e76e-4d65-85f0-f7a35e3b280d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1cc017eb-e76e-4d65-85f0-f7a35e3b280d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-1cc017eb-e76e-4d65-85f0-f7a35e3b280d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:35 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-1cc017eb-e76e-4d65-85f0-f7a35e3b280d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HTTP exception thrown: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-1cc017eb-e76e-4d65-85f0-f7a35e3b280d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Request method failure captured: Apr 14 11:06:35 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e HTTP/1.1 Apr 14 11:06:35 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:06:35 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:06:35 user devstack@n-api.service[61841]: Connection: close Apr 14 11:06:35 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:06:35 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:06:35 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:06:35 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:06:35 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4fQX9Q_RnaEmQ-dAIr-urE_Qf9FeisPSin3UWyuzHmoI_KCuoZr_U9DzdQQueZ8UvQtRxmtFZr_Y67Y5BNWEMQrTX5qpCYKFbqLA-jWMMIHdda2-lQsIJdeeyKqxgQWWAK5mhoWrzOCFu21n0R7jd5he-eoBJ_rPstsQw3ChIPjAc Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Project-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Project-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}] Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Tenant: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Tenant-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:06:35 user devstack@n-api.service[61841]: X-User: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 11:06:35 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:06:35 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:06:35 user devstack@n-api.service[61841]: X-User-Id: 5873a358bf544691b12cd2979f5e36dc Apr 14 11:06:35 user devstack@n-api.service[61841]: X-User-Name: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 11:06:35 user devstack@n-api.service[61841]: method: > Apr 14 11:06:35 user devstack@n-api.service[61841]: exception: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. Apr 14 11:06:35 user devstack@n-api.service[61841]: action_args: {'id': '3db2e71c-939b-4d2f-b1be-c2122f7cd73e'} Apr 14 11:06:35 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-1cc017eb-e76e-4d65-85f0-f7a35e3b280d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Returning 404 to user: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:06:35 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-1cc017eb-e76e-4d65-85f0-f7a35e3b280d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e" status: 404 len: 111 microversion: 2.1 time: 0.054565 Apr 14 11:06:35 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 340/1013] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:06:35 2023] GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=7 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=13 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ee2f6f5a-4ed9-47fb-a916-3af7f59fbd62 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-ee2f6f5a-4ed9-47fb-a916-3af7f59fbd62 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ee2f6f5a-4ed9-47fb-a916-3af7f59fbd62 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ee2f6f5a-4ed9-47fb-a916-3af7f59fbd62 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ee2f6f5a-4ed9-47fb-a916-3af7f59fbd62 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ee2f6f5a-4ed9-47fb-a916-3af7f59fbd62 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ee2f6f5a-4ed9-47fb-a916-3af7f59fbd62 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ee2f6f5a-4ed9-47fb-a916-3af7f59fbd62 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:35 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-ee2f6f5a-4ed9-47fb-a916-3af7f59fbd62 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HTTP exception thrown: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ee2f6f5a-4ed9-47fb-a916-3af7f59fbd62 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Request method failure captured: Apr 14 11:06:35 user devstack@n-api.service[61840]: request: DELETE /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e HTTP/1.1 Apr 14 11:06:35 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:06:35 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:06:35 user devstack@n-api.service[61840]: Connection: close Apr 14 11:06:35 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:06:35 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:06:35 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:06:35 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:06:35 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:06:35 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS4fQX9Q_RnaEmQ-dAIr-urE_Qf9FeisPSin3UWyuzHmoI_KCuoZr_U9DzdQQueZ8UvQtRxmtFZr_Y67Y5BNWEMQrTX5qpCYKFbqLA-jWMMIHdda2-lQsIJdeeyKqxgQWWAK5mhoWrzOCFu21n0R7jd5he-eoBJ_rPstsQw3ChIPjAc Apr 14 11:06:35 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:06:35 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:06:35 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:06:35 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:06:35 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:06:35 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:06:35 user devstack@n-api.service[61840]: X-Project-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 11:06:35 user devstack@n-api.service[61840]: X-Project-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:06:35 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:06:35 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:06:35 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}] Apr 14 11:06:35 user devstack@n-api.service[61840]: X-Tenant: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:06:35 user devstack@n-api.service[61840]: X-Tenant-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 11:06:35 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:06:35 user devstack@n-api.service[61840]: X-User: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 11:06:35 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:06:35 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:06:35 user devstack@n-api.service[61840]: X-User-Id: 5873a358bf544691b12cd2979f5e36dc Apr 14 11:06:35 user devstack@n-api.service[61840]: X-User-Name: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 11:06:35 user devstack@n-api.service[61840]: method: > Apr 14 11:06:35 user devstack@n-api.service[61840]: exception: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. Apr 14 11:06:35 user devstack@n-api.service[61840]: action_args: {'id': '3db2e71c-939b-4d2f-b1be-c2122f7cd73e'} Apr 14 11:06:35 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. Apr 14 11:06:35 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ee2f6f5a-4ed9-47fb-a916-3af7f59fbd62 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Returning 404 to user: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:06:35 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-ee2f6f5a-4ed9-47fb-a916-3af7f59fbd62 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e" status: 404 len: 111 microversion: 2.1 time: 0.042406 Apr 14 11:06:35 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 340/1014] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:06:35 2023] DELETE /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-52dd93b5-71f8-4c41-88ac-cd09f5c387ef tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-52dd93b5-71f8-4c41-88ac-cd09f5c387ef tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-52dd93b5-71f8-4c41-88ac-cd09f5c387ef tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-52dd93b5-71f8-4c41-88ac-cd09f5c387ef tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-52dd93b5-71f8-4c41-88ac-cd09f5c387ef tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-52dd93b5-71f8-4c41-88ac-cd09f5c387ef tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-52dd93b5-71f8-4c41-88ac-cd09f5c387ef tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-52dd93b5-71f8-4c41-88ac-cd09f5c387ef tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:35 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-52dd93b5-71f8-4c41-88ac-cd09f5c387ef tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HTTP exception thrown: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-52dd93b5-71f8-4c41-88ac-cd09f5c387ef tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Request method failure captured: Apr 14 11:06:35 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e HTTP/1.1 Apr 14 11:06:35 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:06:35 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:06:35 user devstack@n-api.service[61841]: Connection: close Apr 14 11:06:35 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:06:35 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:06:35 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:06:35 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:06:35 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOS4fQX9Q_RnaEmQ-dAIr-urE_Qf9FeisPSin3UWyuzHmoI_KCuoZr_U9DzdQQueZ8UvQtRxmtFZr_Y67Y5BNWEMQrTX5qpCYKFbqLA-jWMMIHdda2-lQsIJdeeyKqxgQWWAK5mhoWrzOCFu21n0R7jd5he-eoBJ_rPstsQw3ChIPjAc Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Project-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Project-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}] Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Tenant: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Tenant-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 11:06:35 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:06:35 user devstack@n-api.service[61841]: X-User: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 11:06:35 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:06:35 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:06:35 user devstack@n-api.service[61841]: X-User-Id: 5873a358bf544691b12cd2979f5e36dc Apr 14 11:06:35 user devstack@n-api.service[61841]: X-User-Name: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 11:06:35 user devstack@n-api.service[61841]: method: > Apr 14 11:06:35 user devstack@n-api.service[61841]: exception: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. Apr 14 11:06:35 user devstack@n-api.service[61841]: action_args: {'id': '3db2e71c-939b-4d2f-b1be-c2122f7cd73e'} Apr 14 11:06:35 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. Apr 14 11:06:35 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-52dd93b5-71f8-4c41-88ac-cd09f5c387ef tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Returning 404 to user: Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:06:35 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-52dd93b5-71f8-4c41-88ac-cd09f5c387ef tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e" status: 404 len: 111 microversion: 2.1 time: 0.031710 Apr 14 11:06:35 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 341/1015] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:06:35 2023] GET /compute/v2.1/servers/3db2e71c-939b-4d2f-b1be-c2122f7cd73e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:35 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Going to try to terminate instance {{(pid=61840) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:06:35 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" status: 204 len: 0 microversion: 2.1 time: 0.181531 Apr 14 11:06:35 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 341/1016] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:06:35 2023] DELETE /compute/v2.1/servers/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-f3d07282-5060-4843-82d8-d50c27430761 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-f3d07282-5060-4843-82d8-d50c27430761 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f3d07282-5060-4843-82d8-d50c27430761 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f3d07282-5060-4843-82d8-d50c27430761 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f3d07282-5060-4843-82d8-d50c27430761 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f3d07282-5060-4843-82d8-d50c27430761 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f3d07282-5060-4843-82d8-d50c27430761 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f3d07282-5060-4843-82d8-d50c27430761 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:35 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-f3d07282-5060-4843-82d8-d50c27430761 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:06:35 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-f3d07282-5060-4843-82d8-d50c27430761 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" status: 200 len: 1545 microversion: 2.1 time: 0.202493 Apr 14 11:06:35 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 342/1017] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:06:35 2023] GET /compute/v2.1/servers/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 => generated 1545 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:06:35 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:06:35 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:06:35 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:06:35 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:06:35 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:06:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:35 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:35 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting quotas for project 2e7089cb52574f1daf7f578222bb7a67. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:06:35 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting quotas for user c7644d02bc784e4fb74ebaaceb3affe1 and project 2e7089cb52574f1daf7f578222bb7a67. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:06:35 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:06:35 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='24d3b48b-6ea1-489d-add9-81a2f85cc64a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:06:36 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-7f23593d-af08-4bef-a0c4-f135ee28ea61 req-b82a8722-6869-472b-b408-4dc51458a4ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7", "name": "network-vif-unplugged", "status": "completed", "tag": "ec941aab-7c95-415b-96bc-e74ebaeb9385"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-7f23593d-af08-4bef-a0c4-f135ee28ea61 req-b82a8722-6869-472b-b408-4dc51458a4ec service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-7f23593d-af08-4bef-a0c4-f135ee28ea61 req-b82a8722-6869-472b-b408-4dc51458a4ec service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-7f23593d-af08-4bef-a0c4-f135ee28ea61 req-b82a8722-6869-472b-b408-4dc51458a4ec service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:36 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-7f23593d-af08-4bef-a0c4-f135ee28ea61 req-b82a8722-6869-472b-b408-4dc51458a4ec service nova] Creating event network-vif-unplugged:ec941aab-7c95-415b-96bc-e74ebaeb9385 for instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 on user Apr 14 11:06:36 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-7f23593d-af08-4bef-a0c4-f135ee28ea61 req-b82a8722-6869-472b-b408-4dc51458a4ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039677 Apr 14 11:06:36 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 342/1018] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:36 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.342411 Apr 14 11:06:36 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 335/1019] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:06:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 1345 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:06:36 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-47a0acca-91a0-4345-b405-9d4b2e941252 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:36 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-47a0acca-91a0-4345-b405-9d4b2e941252 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:36 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-47a0acca-91a0-4345-b405-9d4b2e941252 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:06:36 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-47a0acca-91a0-4345-b405-9d4b2e941252 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" status: 200 len: 1051 microversion: 2.1 time: 0.073963 Apr 14 11:06:36 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 343/1020] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:06:36 2023] GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 => generated 1051 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 11:06:36 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-527c9839-675d-4380-bffd-7179d275fd62 req-ec0242c0-7b3e-402a-aaa0-edc002c778c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7", "name": "network-vif-deleted", "tag": "ec941aab-7c95-415b-96bc-e74ebaeb9385"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-527c9839-675d-4380-bffd-7179d275fd62 req-ec0242c0-7b3e-402a-aaa0-edc002c778c6 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-527c9839-675d-4380-bffd-7179d275fd62 req-ec0242c0-7b3e-402a-aaa0-edc002c778c6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-527c9839-675d-4380-bffd-7179d275fd62 req-ec0242c0-7b3e-402a-aaa0-edc002c778c6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:36 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-527c9839-675d-4380-bffd-7179d275fd62 req-ec0242c0-7b3e-402a-aaa0-edc002c778c6 service nova] Creating event network-vif-deleted:ec941aab-7c95-415b-96bc-e74ebaeb9385 for instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 on user Apr 14 11:06:36 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-527c9839-675d-4380-bffd-7179d275fd62 req-ec0242c0-7b3e-402a-aaa0-edc002c778c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034495 Apr 14 11:06:36 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 343/1021] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:38 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-4abfaa77-5e31-4e85-a2e2-a65a203c70b3 req-726b2e0f-e48b-431e-a34d-8839d0abf217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7", "name": "network-vif-plugged", "status": "completed", "tag": "ec941aab-7c95-415b-96bc-e74ebaeb9385"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4abfaa77-5e31-4e85-a2e2-a65a203c70b3 req-726b2e0f-e48b-431e-a34d-8839d0abf217 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4abfaa77-5e31-4e85-a2e2-a65a203c70b3 req-726b2e0f-e48b-431e-a34d-8839d0abf217 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4abfaa77-5e31-4e85-a2e2-a65a203c70b3 req-726b2e0f-e48b-431e-a34d-8839d0abf217 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:38 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-4abfaa77-5e31-4e85-a2e2-a65a203c70b3 req-726b2e0f-e48b-431e-a34d-8839d0abf217 service nova] Creating event network-vif-plugged:ec941aab-7c95-415b-96bc-e74ebaeb9385 for instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 on user Apr 14 11:06:38 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-4abfaa77-5e31-4e85-a2e2-a65a203c70b3 req-726b2e0f-e48b-431e-a34d-8839d0abf217 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029660 Apr 14 11:06:38 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 336/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:38 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-00c8fd6e-7aa4-4df8-b495-88ea848dbd3e req-4d0c8537-0dc2-4039-a947-9a34e46d9107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5", "tag": "76a7a337-1fec-4cd0-b065-5788cf59e2da"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-00c8fd6e-7aa4-4df8-b495-88ea848dbd3e req-4d0c8537-0dc2-4039-a947-9a34e46d9107 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-00c8fd6e-7aa4-4df8-b495-88ea848dbd3e req-4d0c8537-0dc2-4039-a947-9a34e46d9107 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-00c8fd6e-7aa4-4df8-b495-88ea848dbd3e req-4d0c8537-0dc2-4039-a947-9a34e46d9107 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:38 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-00c8fd6e-7aa4-4df8-b495-88ea848dbd3e req-4d0c8537-0dc2-4039-a947-9a34e46d9107 service nova] Creating event network-changed:76a7a337-1fec-4cd0-b065-5788cf59e2da for instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 on user Apr 14 11:06:38 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-00c8fd6e-7aa4-4df8-b495-88ea848dbd3e req-4d0c8537-0dc2-4039-a947-9a34e46d9107 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034113 Apr 14 11:06:38 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 344/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-8bd9be6f-06eb-4da0-a891-708dfdb10ed5 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:40 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-8bd9be6f-06eb-4da0-a891-708dfdb10ed5 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8bd9be6f-06eb-4da0-a891-708dfdb10ed5 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8bd9be6f-06eb-4da0-a891-708dfdb10ed5 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8bd9be6f-06eb-4da0-a891-708dfdb10ed5 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8bd9be6f-06eb-4da0-a891-708dfdb10ed5 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8bd9be6f-06eb-4da0-a891-708dfdb10ed5 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8bd9be6f-06eb-4da0-a891-708dfdb10ed5 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-8bd9be6f-06eb-4da0-a891-708dfdb10ed5 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] HTTP exception thrown: Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 could not be found. Apr 14 11:06:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-8bd9be6f-06eb-4da0-a891-708dfdb10ed5 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Request method failure captured: Apr 14 11:06:40 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 HTTP/1.1 Apr 14 11:06:40 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:06:40 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:06:40 user devstack@n-api.service[61840]: Connection: close Apr 14 11:06:40 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:06:40 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:06:40 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:06:40 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:06:40 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:06:40 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTJW_nWg2J6o5vRSemm_jlYLT0-S7Yb4P258bLmZ_oKhu6WwoM645orauyJVaZxPKqfOe3071SM1yQhGISaiJoewlLZV_YCsGerTXcSPWKP8ETj9kSKFH3ym18ac0vy24ipdNhiqubWRNnQNGdXbdJml0bR5LRKX7PzbHlt-bdy21fA Apr 14 11:06:40 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:06:40 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:06:40 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:06:40 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:06:40 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:06:40 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:06:40 user devstack@n-api.service[61840]: X-Project-Id: 5809862340a84c83a772c65c77513608 Apr 14 11:06:40 user devstack@n-api.service[61840]: X-Project-Name: tempest-TestMinimumBasicScenario-2127394977 Apr 14 11:06:40 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:06:40 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:06:40 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5809862340a84c83a772c65c77513608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5809862340a84c83a772c65c77513608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5809862340a84c83a772c65c77513608"}]}] Apr 14 11:06:40 user devstack@n-api.service[61840]: X-Tenant: tempest-TestMinimumBasicScenario-2127394977 Apr 14 11:06:40 user devstack@n-api.service[61840]: X-Tenant-Id: 5809862340a84c83a772c65c77513608 Apr 14 11:06:40 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2127394977 Apr 14 11:06:40 user devstack@n-api.service[61840]: X-User: tempest-TestMinimumBasicScenario-2127394977-project-member Apr 14 11:06:40 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:06:40 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:06:40 user devstack@n-api.service[61840]: X-User-Id: 831215baa8fd4fe7ba65193bbbdad1b4 Apr 14 11:06:40 user devstack@n-api.service[61840]: X-User-Name: tempest-TestMinimumBasicScenario-2127394977-project-member Apr 14 11:06:40 user devstack@n-api.service[61840]: method: > Apr 14 11:06:40 user devstack@n-api.service[61840]: exception: Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 could not be found. Apr 14 11:06:40 user devstack@n-api.service[61840]: action_args: {'id': '9c4cc2a1-0c54-4f20-b33f-9085af7b10a3'} Apr 14 11:06:40 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 could not be found. Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 could not be found. Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 could not be found. Apr 14 11:06:40 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:06:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-8bd9be6f-06eb-4da0-a891-708dfdb10ed5 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Returning 404 to user: Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:06:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-8bd9be6f-06eb-4da0-a891-708dfdb10ed5 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" status: 404 len: 111 microversion: 2.1 time: 0.027700 Apr 14 11:06:40 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 344/1024] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:06:40 2023] GET /compute/v2.1/servers/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:06:40 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8a559691-112c-4b3a-bf17-c5b4777efd7e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '.version_select at 0x7fcd1ce537f0>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:40 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-8a559691-112c-4b3a-bf17-c5b4777efd7e tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1104464810" status: 202 len: 0 microversion: 2.1 time: 0.026678 Apr 14 11:06:40 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 337/1025] 10.0.0.210 () {62 vars in 1349 bytes} [Fri Apr 14 11:06:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1104464810 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:06:43 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-04557ba9-0e7a-4b7b-85fb-2f2828268ab8 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Action: 'create', calling method: .version_select at 0x7fcd1cfba4d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1135167667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6ZxpnOnwCD8++AKCw08DAo5uRuXS1qhshnTNxj6xmDqjI3Q4e5zyIEi9HPx2ijCKifpCb4oBzu+Rg40bzqM2EcC2gqsAhMQLM5Csl2BMJQ3L+MgH2g/mWsmYIR45G7+A=="}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:43 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-04557ba9-0e7a-4b7b-85fb-2f2828268ab8 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Getting quotas for project 5809862340a84c83a772c65c77513608. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:06:43 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-04557ba9-0e7a-4b7b-85fb-2f2828268ab8 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Getting quotas for user 831215baa8fd4fe7ba65193bbbdad1b4 and project 5809862340a84c83a772c65c77513608. Resources: {'key_pairs'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:06:43 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-04557ba9-0e7a-4b7b-85fb-2f2828268ab8 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053790 Apr 14 11:06:43 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 345/1026] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 11:06:43 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:43 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1969920784", "imageRef": "a08e5ed8-d3a1-4c04-b424-dd862d7803ae", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1135167667", "networks": [{"uuid": "d59680e7-ed50-4356-b665-ec64ff939708"}]}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:43 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] validate_networks() for [('d59680e7-ed50-4356-b665-ec64ff939708', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:06:44 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:06:44 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:06:44 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:06:44 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:06:44 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:06:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:44 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Getting quotas for project 5809862340a84c83a772c65c77513608. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:06:44 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Getting quotas for user 831215baa8fd4fe7ba65193bbbdad1b4 and project 5809862340a84c83a772c65c77513608. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:06:44 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:06:44 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a08e5ed8-d3a1-4c04-b424-dd862d7803ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:06:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.552811 Apr 14 11:06:44 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 345/1027] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:06:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:06:44 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8cfa987d-e59d-4864-8ba5-32b4140d5e2a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:44 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-8cfa987d-e59d-4864-8ba5-32b4140d5e2a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:44 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-8cfa987d-e59d-4864-8ba5-32b4140d5e2a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:06:44 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-8cfa987d-e59d-4864-8ba5-32b4140d5e2a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" status: 200 len: 1253 microversion: 2.1 time: 0.067900 Apr 14 11:06:44 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 338/1028] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:06:44 2023] GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => generated 1253 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:06:46 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-daf89855-3591-493c-a59a-76cff5bc927e req-8740317f-004b-464c-822c-393763dd55e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99", "tag": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-daf89855-3591-493c-a59a-76cff5bc927e req-8740317f-004b-464c-822c-393763dd55e6 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-daf89855-3591-493c-a59a-76cff5bc927e req-8740317f-004b-464c-822c-393763dd55e6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:46 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-daf89855-3591-493c-a59a-76cff5bc927e req-8740317f-004b-464c-822c-393763dd55e6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:47 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-daf89855-3591-493c-a59a-76cff5bc927e req-8740317f-004b-464c-822c-393763dd55e6 service nova] Creating event network-changed:cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 on user Apr 14 11:06:47 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-daf89855-3591-493c-a59a-76cff5bc927e req-8740317f-004b-464c-822c-393763dd55e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044900 Apr 14 11:06:47 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 346/1029] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:49 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-b9ffb09b-cb58-4608-8a59-ac975f37fc1a req-a50ad85d-bd06-4b06-b2cb-8e9e54e4b6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99", "name": "network-vif-plugged", "status": "completed", "tag": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b9ffb09b-cb58-4608-8a59-ac975f37fc1a req-a50ad85d-bd06-4b06-b2cb-8e9e54e4b6b0 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b9ffb09b-cb58-4608-8a59-ac975f37fc1a req-a50ad85d-bd06-4b06-b2cb-8e9e54e4b6b0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-b9ffb09b-cb58-4608-8a59-ac975f37fc1a req-a50ad85d-bd06-4b06-b2cb-8e9e54e4b6b0 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-b9ffb09b-cb58-4608-8a59-ac975f37fc1a req-a50ad85d-bd06-4b06-b2cb-8e9e54e4b6b0 service nova] Creating event network-vif-plugged:cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 on user Apr 14 11:06:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-b9ffb09b-cb58-4608-8a59-ac975f37fc1a req-a50ad85d-bd06-4b06-b2cb-8e9e54e4b6b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031212 Apr 14 11:06:49 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 346/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:50 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-cce56e45-a151-43eb-a646-e09d734cce09 req-3e427141-99bc-4360-89d5-d6ca67083aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5", "name": "network-vif-plugged", "status": "completed", "tag": "76a7a337-1fec-4cd0-b065-5788cf59e2da"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:50 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:50 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:50 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cce56e45-a151-43eb-a646-e09d734cce09 req-3e427141-99bc-4360-89d5-d6ca67083aed service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:50 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cce56e45-a151-43eb-a646-e09d734cce09 req-3e427141-99bc-4360-89d5-d6ca67083aed service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:50 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cce56e45-a151-43eb-a646-e09d734cce09 req-3e427141-99bc-4360-89d5-d6ca67083aed service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:50 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-cce56e45-a151-43eb-a646-e09d734cce09 req-3e427141-99bc-4360-89d5-d6ca67083aed service nova] Creating event network-vif-plugged:76a7a337-1fec-4cd0-b065-5788cf59e2da for instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 on user Apr 14 11:06:50 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-cce56e45-a151-43eb-a646-e09d734cce09 req-3e427141-99bc-4360-89d5-d6ca67083aed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042269 Apr 14 11:06:50 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 339/1031] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:51 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-0088dcee-9288-4680-ad21-1094e5e0db7b req-ff9797dc-01d2-41d6-a58c-41e28792fc11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99", "name": "network-vif-plugged", "status": "completed", "tag": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-0088dcee-9288-4680-ad21-1094e5e0db7b req-ff9797dc-01d2-41d6-a58c-41e28792fc11 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-0088dcee-9288-4680-ad21-1094e5e0db7b req-ff9797dc-01d2-41d6-a58c-41e28792fc11 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:51 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-0088dcee-9288-4680-ad21-1094e5e0db7b req-ff9797dc-01d2-41d6-a58c-41e28792fc11 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:51 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-0088dcee-9288-4680-ad21-1094e5e0db7b req-ff9797dc-01d2-41d6-a58c-41e28792fc11 service nova] Creating event network-vif-plugged:cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 on user Apr 14 11:06:51 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-0088dcee-9288-4680-ad21-1094e5e0db7b req-ff9797dc-01d2-41d6-a58c-41e28792fc11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031984 Apr 14 11:06:51 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 347/1032] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:52 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-e605e675-fb54-40cf-b920-41c918cd7b09 req-81d5f6ce-bebb-4dd6-8868-4dbe3dca0a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5", "name": "network-vif-plugged", "status": "completed", "tag": "76a7a337-1fec-4cd0-b065-5788cf59e2da"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:52 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-e605e675-fb54-40cf-b920-41c918cd7b09 req-81d5f6ce-bebb-4dd6-8868-4dbe3dca0a6f service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:52 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-e605e675-fb54-40cf-b920-41c918cd7b09 req-81d5f6ce-bebb-4dd6-8868-4dbe3dca0a6f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:52 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-e605e675-fb54-40cf-b920-41c918cd7b09 req-81d5f6ce-bebb-4dd6-8868-4dbe3dca0a6f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:52 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-e605e675-fb54-40cf-b920-41c918cd7b09 req-81d5f6ce-bebb-4dd6-8868-4dbe3dca0a6f service nova] Creating event network-vif-plugged:76a7a337-1fec-4cd0-b065-5788cf59e2da for instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 on user Apr 14 11:06:52 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-e605e675-fb54-40cf-b920-41c918cd7b09 req-81d5f6ce-bebb-4dd6-8868-4dbe3dca0a6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038020 Apr 14 11:06:52 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 347/1033] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:53 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f7cfe5aa-7d9d-4163-a978-9131c686e178 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:53 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-f7cfe5aa-7d9d-4163-a978-9131c686e178 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cfe5aa-7d9d-4163-a978-9131c686e178 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cfe5aa-7d9d-4163-a978-9131c686e178 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cfe5aa-7d9d-4163-a978-9131c686e178 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cfe5aa-7d9d-4163-a978-9131c686e178 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cfe5aa-7d9d-4163-a978-9131c686e178 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f7cfe5aa-7d9d-4163-a978-9131c686e178 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:53 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-f7cfe5aa-7d9d-4163-a978-9131c686e178 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] HTTP exception thrown: Instance 6cae9f61-763f-4671-a873-d15f01384416 could not be found. Apr 14 11:06:53 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f7cfe5aa-7d9d-4163-a978-9131c686e178 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Request method failure captured: Apr 14 11:06:53 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416 HTTP/1.1 Apr 14 11:06:53 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:06:53 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:06:53 user devstack@n-api.service[61839]: Connection: close Apr 14 11:06:53 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:06:53 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:06:53 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:06:53 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:06:53 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS8E-UO3BI5f7b6x50N3vDY0vRMFs_uZm8-H9vMJmHi_iiDftAa0EnpcQYQbE80P6WQhfxAHEAXNgHj-2f1MRH59Q-QaVTEXSktnZkrjGNxMQhD0V9gm5P_FZkrUUJopC-KIf72jcPzhH7K40SInM3QE33ccY0pw2ZuA-2a78raF9ys Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Project-Id: 71289f80a05141f482cb538dac3d7b38 Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2130542140 Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71289f80a05141f482cb538dac3d7b38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71289f80a05141f482cb538dac3d7b38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71289f80a05141f482cb538dac3d7b38"}]}] Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2130542140 Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Tenant-Id: 71289f80a05141f482cb538dac3d7b38 Apr 14 11:06:53 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2130542140 Apr 14 11:06:53 user devstack@n-api.service[61839]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member Apr 14 11:06:53 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:06:53 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:06:53 user devstack@n-api.service[61839]: X-User-Id: 395bc9d7007c4e01ac7effd418bcea19 Apr 14 11:06:53 user devstack@n-api.service[61839]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member Apr 14 11:06:53 user devstack@n-api.service[61839]: method: > Apr 14 11:06:53 user devstack@n-api.service[61839]: exception: Instance 6cae9f61-763f-4671-a873-d15f01384416 could not be found. Apr 14 11:06:53 user devstack@n-api.service[61839]: action_args: {'id': '6cae9f61-763f-4671-a873-d15f01384416'} Apr 14 11:06:53 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cae9f61-763f-4671-a873-d15f01384416 could not be found. Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cae9f61-763f-4671-a873-d15f01384416 could not be found. Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cae9f61-763f-4671-a873-d15f01384416 could not be found. Apr 14 11:06:53 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:06:53 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f7cfe5aa-7d9d-4163-a978-9131c686e178 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Returning 404 to user: Instance 6cae9f61-763f-4671-a873-d15f01384416 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:06:53 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-f7cfe5aa-7d9d-4163-a978-9131c686e178 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416" status: 404 len: 111 microversion: 2.87 time: 0.035009 Apr 14 11:06:53 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 340/1034] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:06:53 2023] GET /compute/v2.1/servers/6cae9f61-763f-4671-a873-d15f01384416 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 11:06:53 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:53 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:53 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:53 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:53 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Going to try to terminate instance {{(pid=61841) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:06:53 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07" status: 204 len: 0 microversion: 2.87 time: 0.120352 Apr 14 11:06:53 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 348/1035] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 11:06:53 2023] DELETE /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 11:06:53 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-1709d103-1f0d-4849-9912-eb5e4a0e437d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:53 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-1709d103-1f0d-4849-9912-eb5e4a0e437d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1709d103-1f0d-4849-9912-eb5e4a0e437d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1709d103-1f0d-4849-9912-eb5e4a0e437d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1709d103-1f0d-4849-9912-eb5e4a0e437d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1709d103-1f0d-4849-9912-eb5e4a0e437d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1709d103-1f0d-4849-9912-eb5e4a0e437d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:53 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-1709d103-1f0d-4849-9912-eb5e4a0e437d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:54 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-bf7a516c-ea7d-4570-a8a8-d15863febe63 req-c3e8cc37-3805-4ba9-8bf7-7c760753a627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e479154a-acd6-47aa-9a5b-43c6e0feda07", "name": "network-vif-unplugged", "status": "completed", "tag": "2fbfd894-8e16-4039-b726-638e802602c5"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:54 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:54 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-bf7a516c-ea7d-4570-a8a8-d15863febe63 req-c3e8cc37-3805-4ba9-8bf7-7c760753a627 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:54 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-bf7a516c-ea7d-4570-a8a8-d15863febe63 req-c3e8cc37-3805-4ba9-8bf7-7c760753a627 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:54 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-bf7a516c-ea7d-4570-a8a8-d15863febe63 req-c3e8cc37-3805-4ba9-8bf7-7c760753a627 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:54 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-bf7a516c-ea7d-4570-a8a8-d15863febe63 req-c3e8cc37-3805-4ba9-8bf7-7c760753a627 service nova] Creating event network-vif-unplugged:2fbfd894-8e16-4039-b726-638e802602c5 for instance e479154a-acd6-47aa-9a5b-43c6e0feda07 on user Apr 14 11:06:54 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-bf7a516c-ea7d-4570-a8a8-d15863febe63 req-c3e8cc37-3805-4ba9-8bf7-7c760753a627 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037361 Apr 14 11:06:54 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 349/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:54 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:54 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-991a0b32-5e9e-4bf3-bb7a-a0d252a2f10e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:06:54 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-991a0b32-5e9e-4bf3-bb7a-a0d252a2f10e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:06:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-991a0b32-5e9e-4bf3-bb7a-a0d252a2f10e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-991a0b32-5e9e-4bf3-bb7a-a0d252a2f10e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-991a0b32-5e9e-4bf3-bb7a-a0d252a2f10e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-991a0b32-5e9e-4bf3-bb7a-a0d252a2f10e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-991a0b32-5e9e-4bf3-bb7a-a0d252a2f10e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:54 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-991a0b32-5e9e-4bf3-bb7a-a0d252a2f10e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:54 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=8 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:06:54 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-991a0b32-5e9e-4bf3-bb7a-a0d252a2f10e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] HTTP exception thrown: Instance 269aa265-9398-4692-8ab4-f3bf5be82714 could not be found. Apr 14 11:06:54 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-991a0b32-5e9e-4bf3-bb7a-a0d252a2f10e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Request method failure captured: Apr 14 11:06:54 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/269aa265-9398-4692-8ab4-f3bf5be82714 HTTP/1.1 Apr 14 11:06:54 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:06:54 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:06:54 user devstack@n-api.service[61839]: Connection: close Apr 14 11:06:54 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:06:54 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:06:54 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:06:54 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:06:54 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:06:54 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTKGlMS3eQFRrRShvpHH7ZAz06SJJ3sUJ5YBp6h5a2emPtIFJtmVFwRFyaHGJzVlZdDu1XjUbnkS-vdDrOLCTuS58lzVXkfASfM2oaYSu0LruLWZBbNRUHtT4x8jzBBRP1B4z7Eb0XL_tGHDiBls26ZkOL-PcAOihSmqwveChPESx8M Apr 14 11:06:54 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:06:54 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:06:54 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:06:54 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:06:54 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:06:54 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:06:54 user devstack@n-api.service[61839]: X-Project-Id: 1310da753ca94b38a7c660b8613af044 Apr 14 11:06:54 user devstack@n-api.service[61839]: X-Project-Name: tempest-VolumesActionsTest-1201626915 Apr 14 11:06:54 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:06:54 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:06:54 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1310da753ca94b38a7c660b8613af044"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1310da753ca94b38a7c660b8613af044"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1310da753ca94b38a7c660b8613af044"}]}] Apr 14 11:06:54 user devstack@n-api.service[61839]: X-Tenant: tempest-VolumesActionsTest-1201626915 Apr 14 11:06:54 user devstack@n-api.service[61839]: X-Tenant-Id: 1310da753ca94b38a7c660b8613af044 Apr 14 11:06:54 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-VolumesActionsTest-1201626915 Apr 14 11:06:54 user devstack@n-api.service[61839]: X-User: tempest-VolumesActionsTest-1201626915-project-member Apr 14 11:06:54 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:06:54 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:06:54 user devstack@n-api.service[61839]: X-User-Id: 282af802879e463ea87844b5fc926692 Apr 14 11:06:54 user devstack@n-api.service[61839]: X-User-Name: tempest-VolumesActionsTest-1201626915-project-member Apr 14 11:06:54 user devstack@n-api.service[61839]: method: > Apr 14 11:06:54 user devstack@n-api.service[61839]: exception: Instance 269aa265-9398-4692-8ab4-f3bf5be82714 could not be found. Apr 14 11:06:54 user devstack@n-api.service[61839]: action_args: {'id': '269aa265-9398-4692-8ab4-f3bf5be82714'} Apr 14 11:06:54 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 269aa265-9398-4692-8ab4-f3bf5be82714 could not be found. Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 269aa265-9398-4692-8ab4-f3bf5be82714 could not be found. Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 269aa265-9398-4692-8ab4-f3bf5be82714 could not be found. Apr 14 11:06:54 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:06:54 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-991a0b32-5e9e-4bf3-bb7a-a0d252a2f10e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Returning 404 to user: Instance 269aa265-9398-4692-8ab4-f3bf5be82714 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:06:54 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-991a0b32-5e9e-4bf3-bb7a-a0d252a2f10e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/269aa265-9398-4692-8ab4-f3bf5be82714" status: 404 len: 111 microversion: 2.1 time: 0.281923 Apr 14 11:06:54 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 341/1037] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:06:53 2023] GET /compute/v2.1/servers/269aa265-9398-4692-8ab4-f3bf5be82714 => generated 111 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 11:06:54 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-1709d103-1f0d-4849-9912-eb5e4a0e437d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:06:54 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-1709d103-1f0d-4849-9912-eb5e4a0e437d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:06:54 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-1709d103-1f0d-4849-9912-eb5e4a0e437d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:06:54 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-1709d103-1f0d-4849-9912-eb5e4a0e437d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07" status: 200 len: 1696 microversion: 2.87 time: 0.926666 Apr 14 11:06:54 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 348/1038] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:06:53 2023] GET /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07 => generated 1696 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 11:06:55 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-efc0e311-727e-45f7-9072-485217ac6d6f req-2a57a04f-a0c7-4be1-97bb-cac2b0dc2243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e479154a-acd6-47aa-9a5b-43c6e0feda07", "name": "network-vif-deleted", "tag": "2fbfd894-8e16-4039-b726-638e802602c5"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-efc0e311-727e-45f7-9072-485217ac6d6f req-2a57a04f-a0c7-4be1-97bb-cac2b0dc2243 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-efc0e311-727e-45f7-9072-485217ac6d6f req-2a57a04f-a0c7-4be1-97bb-cac2b0dc2243 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-efc0e311-727e-45f7-9072-485217ac6d6f req-2a57a04f-a0c7-4be1-97bb-cac2b0dc2243 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:55 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-efc0e311-727e-45f7-9072-485217ac6d6f req-2a57a04f-a0c7-4be1-97bb-cac2b0dc2243 service nova] Creating event network-vif-deleted:2fbfd894-8e16-4039-b726-638e802602c5 for instance e479154a-acd6-47aa-9a5b-43c6e0feda07 on user Apr 14 11:06:55 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-efc0e311-727e-45f7-9072-485217ac6d6f req-2a57a04f-a0c7-4be1-97bb-cac2b0dc2243 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039150 Apr 14 11:06:55 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 350/1039] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:06:56 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-78345315-efff-46f3-bcfd-1c047a44b6c9 req-024ffd56-f1a4-454f-9246-ff7ad4afc614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e479154a-acd6-47aa-9a5b-43c6e0feda07", "name": "network-vif-plugged", "status": "completed", "tag": "2fbfd894-8e16-4039-b726-638e802602c5"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:06:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-78345315-efff-46f3-bcfd-1c047a44b6c9 req-024ffd56-f1a4-454f-9246-ff7ad4afc614 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:06:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-78345315-efff-46f3-bcfd-1c047a44b6c9 req-024ffd56-f1a4-454f-9246-ff7ad4afc614 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:06:56 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-78345315-efff-46f3-bcfd-1c047a44b6c9 req-024ffd56-f1a4-454f-9246-ff7ad4afc614 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:06:56 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-78345315-efff-46f3-bcfd-1c047a44b6c9 req-024ffd56-f1a4-454f-9246-ff7ad4afc614 service nova] Creating event network-vif-plugged:2fbfd894-8e16-4039-b726-638e802602c5 for instance e479154a-acd6-47aa-9a5b-43c6e0feda07 on user Apr 14 11:06:56 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-78345315-efff-46f3-bcfd-1c047a44b6c9 req-024ffd56-f1a4-454f-9246-ff7ad4afc614 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030975 Apr 14 11:06:56 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 342/1040] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:06:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 11:07:25 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-b098e4b4-edd6-4346-ac85-6aeba0b1f09a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:07:25 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-b098e4b4-edd6-4346-ac85-6aeba0b1f09a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:07:25 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:07:25 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:07:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b098e4b4-edd6-4346-ac85-6aeba0b1f09a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:07:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b098e4b4-edd6-4346-ac85-6aeba0b1f09a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:07:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b098e4b4-edd6-4346-ac85-6aeba0b1f09a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:07:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b098e4b4-edd6-4346-ac85-6aeba0b1f09a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:07:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b098e4b4-edd6-4346-ac85-6aeba0b1f09a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:07:25 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-b098e4b4-edd6-4346-ac85-6aeba0b1f09a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:07:25 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-b098e4b4-edd6-4346-ac85-6aeba0b1f09a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HTTP exception thrown: Instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 could not be found. Apr 14 11:07:25 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-b098e4b4-edd6-4346-ac85-6aeba0b1f09a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Request method failure captured: Apr 14 11:07:25 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 HTTP/1.1 Apr 14 11:07:25 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:07:25 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:07:25 user devstack@n-api.service[61840]: Connection: close Apr 14 11:07:25 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:07:25 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:07:25 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:07:25 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:07:25 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:07:25 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS4fQX9Q_RnaEmQ-dAIr-urE_Qf9FeisPSin3UWyuzHmoI_KCuoZr_U9DzdQQueZ8UvQtRxmtFZr_Y67Y5BNWEMQrTX5qpCYKFbqLA-jWMMIHdda2-lQsIJdeeyKqxgQWWAK5mhoWrzOCFu21n0R7jd5he-eoBJ_rPstsQw3ChIPjAc Apr 14 11:07:25 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:07:25 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:07:25 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:07:25 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:07:25 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:07:25 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:07:25 user devstack@n-api.service[61840]: X-Project-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 11:07:25 user devstack@n-api.service[61840]: X-Project-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:07:25 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:07:25 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:07:25 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}] Apr 14 11:07:25 user devstack@n-api.service[61840]: X-Tenant: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:07:25 user devstack@n-api.service[61840]: X-Tenant-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 11:07:25 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:07:25 user devstack@n-api.service[61840]: X-User: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 11:07:25 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:07:25 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:07:25 user devstack@n-api.service[61840]: X-User-Id: 5873a358bf544691b12cd2979f5e36dc Apr 14 11:07:25 user devstack@n-api.service[61840]: X-User-Name: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 11:07:25 user devstack@n-api.service[61840]: method: > Apr 14 11:07:25 user devstack@n-api.service[61840]: exception: Instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 could not be found. Apr 14 11:07:25 user devstack@n-api.service[61840]: action_args: {'id': '0dd9e11f-1fed-42af-ad5c-9cdd051b93e7'} Apr 14 11:07:25 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 could not be found. Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 could not be found. Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 could not be found. Apr 14 11:07:25 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:07:25 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-b098e4b4-edd6-4346-ac85-6aeba0b1f09a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Returning 404 to user: Instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:07:25 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-b098e4b4-edd6-4346-ac85-6aeba0b1f09a tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" status: 404 len: 111 microversion: 2.1 time: 0.031907 Apr 14 11:07:25 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 349/1041] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:07:25 2023] GET /compute/v2.1/servers/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:07:26 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:07:26 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:07:26 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-cd84a990-693b-4211-a3fb-15aa384139f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:07:26 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-cd84a990-693b-4211-a3fb-15aa384139f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:07:26 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-cd84a990-693b-4211-a3fb-15aa384139f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:07:26 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-cd84a990-693b-4211-a3fb-15aa384139f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:07:26 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-cd84a990-693b-4211-a3fb-15aa384139f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:07:26 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-cd84a990-693b-4211-a3fb-15aa384139f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:07:26 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-cd84a990-693b-4211-a3fb-15aa384139f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:07:26 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-cd84a990-693b-4211-a3fb-15aa384139f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:07:26 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-cd84a990-693b-4211-a3fb-15aa384139f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:07:26 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-cd84a990-693b-4211-a3fb-15aa384139f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" status: 200 len: 1378 microversion: 2.1 time: 0.158702 Apr 14 11:07:26 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 351/1042] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:07:26 2023] GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 => generated 1378 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:07:32 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-2d3faa1f-8997-42ed-b971-642b708fe435 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:07:32 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-2d3faa1f-8997-42ed-b971-642b708fe435 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:07:32 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:07:32 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=8 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:07:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2d3faa1f-8997-42ed-b971-642b708fe435 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:07:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2d3faa1f-8997-42ed-b971-642b708fe435 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:07:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2d3faa1f-8997-42ed-b971-642b708fe435 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:07:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2d3faa1f-8997-42ed-b971-642b708fe435 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:07:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2d3faa1f-8997-42ed-b971-642b708fe435 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:07:32 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-2d3faa1f-8997-42ed-b971-642b708fe435 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:07:32 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-2d3faa1f-8997-42ed-b971-642b708fe435 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HTTP exception thrown: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 11:07:32 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-2d3faa1f-8997-42ed-b971-642b708fe435 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Request method failure captured: Apr 14 11:07:32 user devstack@n-api.service[61839]: request: DELETE /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 HTTP/1.1 Apr 14 11:07:32 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:07:32 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:07:32 user devstack@n-api.service[61839]: Connection: close Apr 14 11:07:32 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:07:32 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:07:32 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:07:32 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:07:32 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:07:32 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOS4fQX9Q_RnaEmQ-dAIr-urE_Qf9FeisPSin3UWyuzHmoI_KCuoZr_U9DzdQQueZ8UvQtRxmtFZr_Y67Y5BNWEMQrTX5qpCYKFbqLA-jWMMIHdda2-lQsIJdeeyKqxgQWWAK5mhoWrzOCFu21n0R7jd5he-eoBJ_rPstsQw3ChIPjAc Apr 14 11:07:32 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:07:32 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:07:32 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:07:32 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:07:32 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:07:32 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:07:32 user devstack@n-api.service[61839]: X-Project-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 11:07:32 user devstack@n-api.service[61839]: X-Project-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:07:32 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:07:32 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:07:32 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}] Apr 14 11:07:32 user devstack@n-api.service[61839]: X-Tenant: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:07:32 user devstack@n-api.service[61839]: X-Tenant-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 11:07:32 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:07:32 user devstack@n-api.service[61839]: X-User: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 11:07:32 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:07:32 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:07:32 user devstack@n-api.service[61839]: X-User-Id: 5873a358bf544691b12cd2979f5e36dc Apr 14 11:07:32 user devstack@n-api.service[61839]: X-User-Name: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 11:07:32 user devstack@n-api.service[61839]: method: > Apr 14 11:07:32 user devstack@n-api.service[61839]: exception: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 11:07:32 user devstack@n-api.service[61839]: action_args: {'id': 'b4abb549-8f36-40c5-971f-8accbb14ff86'} Apr 14 11:07:32 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 11:07:32 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:07:32 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-2d3faa1f-8997-42ed-b971-642b708fe435 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Returning 404 to user: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:07:32 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-2d3faa1f-8997-42ed-b971-642b708fe435 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 404 len: 111 microversion: 2.1 time: 0.042740 Apr 14 11:07:32 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 343/1043] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:07:32 2023] DELETE /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:07:32 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-8202c7c5-dba1-4b90-8a84-d5320417c5b7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:07:32 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-8202c7c5-dba1-4b90-8a84-d5320417c5b7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:07:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8202c7c5-dba1-4b90-8a84-d5320417c5b7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:07:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8202c7c5-dba1-4b90-8a84-d5320417c5b7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:07:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8202c7c5-dba1-4b90-8a84-d5320417c5b7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:07:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8202c7c5-dba1-4b90-8a84-d5320417c5b7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:07:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8202c7c5-dba1-4b90-8a84-d5320417c5b7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:07:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-8202c7c5-dba1-4b90-8a84-d5320417c5b7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:07:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-8202c7c5-dba1-4b90-8a84-d5320417c5b7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HTTP exception thrown: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 11:07:32 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-8202c7c5-dba1-4b90-8a84-d5320417c5b7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Request method failure captured: Apr 14 11:07:32 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 HTTP/1.1 Apr 14 11:07:32 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:07:32 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:07:32 user devstack@n-api.service[61840]: Connection: close Apr 14 11:07:32 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:07:32 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:07:32 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:07:32 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:07:32 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:07:32 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS4fQX9Q_RnaEmQ-dAIr-urE_Qf9FeisPSin3UWyuzHmoI_KCuoZr_U9DzdQQueZ8UvQtRxmtFZr_Y67Y5BNWEMQrTX5qpCYKFbqLA-jWMMIHdda2-lQsIJdeeyKqxgQWWAK5mhoWrzOCFu21n0R7jd5he-eoBJ_rPstsQw3ChIPjAc Apr 14 11:07:32 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:07:32 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:07:32 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:07:32 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:07:32 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:07:32 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:07:32 user devstack@n-api.service[61840]: X-Project-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 11:07:32 user devstack@n-api.service[61840]: X-Project-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:07:32 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:07:32 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:07:32 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea2cb4dfa5b4a52b658efd8f5aefb36"}]}] Apr 14 11:07:32 user devstack@n-api.service[61840]: X-Tenant: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:07:32 user devstack@n-api.service[61840]: X-Tenant-Id: 3ea2cb4dfa5b4a52b658efd8f5aefb36 Apr 14 11:07:32 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-ServerActionsTestJSON-1923052090 Apr 14 11:07:32 user devstack@n-api.service[61840]: X-User: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 11:07:32 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:07:32 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:07:32 user devstack@n-api.service[61840]: X-User-Id: 5873a358bf544691b12cd2979f5e36dc Apr 14 11:07:32 user devstack@n-api.service[61840]: X-User-Name: tempest-ServerActionsTestJSON-1923052090-project-member Apr 14 11:07:32 user devstack@n-api.service[61840]: method: > Apr 14 11:07:32 user devstack@n-api.service[61840]: exception: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 11:07:32 user devstack@n-api.service[61840]: action_args: {'id': 'b4abb549-8f36-40c5-971f-8accbb14ff86'} Apr 14 11:07:32 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. Apr 14 11:07:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:07:32 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-8202c7c5-dba1-4b90-8a84-d5320417c5b7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Returning 404 to user: Instance b4abb549-8f36-40c5-971f-8accbb14ff86 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:07:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-8202c7c5-dba1-4b90-8a84-d5320417c5b7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86" status: 404 len: 111 microversion: 2.1 time: 0.036389 Apr 14 11:07:32 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 350/1044] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:07:32 2023] GET /compute/v2.1/servers/b4abb549-8f36-40c5-971f-8accbb14ff86 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:07:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-f2196fd4-a7a3-4fb2-a402-fcaecc06c9f4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Calling method '.version_select at 0x7fcd1cf58790>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:07:32 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-f2196fd4-a7a3-4fb2-a402-fcaecc06c9f4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544270235" status: 202 len: 0 microversion: 2.1 time: 0.020190 Apr 14 11:07:32 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 352/1045] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 11:07:32 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544270235 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:07:34 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-c60338fe-4b00-4cbc-9cb8-9a3c6624af90 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:07:34 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-c60338fe-4b00-4cbc-9cb8-9a3c6624af90 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:07:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c60338fe-4b00-4cbc-9cb8-9a3c6624af90 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:07:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c60338fe-4b00-4cbc-9cb8-9a3c6624af90 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:07:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c60338fe-4b00-4cbc-9cb8-9a3c6624af90 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:07:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c60338fe-4b00-4cbc-9cb8-9a3c6624af90 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:07:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c60338fe-4b00-4cbc-9cb8-9a3c6624af90 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:07:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c60338fe-4b00-4cbc-9cb8-9a3c6624af90 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:07:34 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-c60338fe-4b00-4cbc-9cb8-9a3c6624af90 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:07:34 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-c60338fe-4b00-4cbc-9cb8-9a3c6624af90 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" status: 200 len: 1536 microversion: 2.1 time: 0.230062 Apr 14 11:07:34 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 344/1046] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:07:34 2023] GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => generated 1536 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:07:44 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-4abce0a1-3f16-4089-a889-2d4f851a1f33 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:07:44 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-4abce0a1-3f16-4089-a889-2d4f851a1f33 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:07:44 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:07:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4abce0a1-3f16-4089-a889-2d4f851a1f33 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:07:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4abce0a1-3f16-4089-a889-2d4f851a1f33 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:07:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4abce0a1-3f16-4089-a889-2d4f851a1f33 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:07:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4abce0a1-3f16-4089-a889-2d4f851a1f33 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:07:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4abce0a1-3f16-4089-a889-2d4f851a1f33 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:07:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-4abce0a1-3f16-4089-a889-2d4f851a1f33 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:07:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-4abce0a1-3f16-4089-a889-2d4f851a1f33 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] HTTP exception thrown: Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 could not be found. Apr 14 11:07:44 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-4abce0a1-3f16-4089-a889-2d4f851a1f33 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Request method failure captured: Apr 14 11:07:44 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07 HTTP/1.1 Apr 14 11:07:44 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:07:44 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:07:44 user devstack@n-api.service[61840]: Connection: close Apr 14 11:07:44 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:07:44 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:07:44 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:07:44 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:07:44 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOS8E-UO3BI5f7b6x50N3vDY0vRMFs_uZm8-H9vMJmHi_iiDftAa0EnpcQYQbE80P6WQhfxAHEAXNgHj-2f1MRH59Q-QaVTEXSktnZkrjGNxMQhD0V9gm5P_FZkrUUJopC-KIf72jcPzhH7K40SInM3QE33ccY0pw2ZuA-2a78raF9ys Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Project-Id: 71289f80a05141f482cb538dac3d7b38 Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-2130542140 Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71289f80a05141f482cb538dac3d7b38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71289f80a05141f482cb538dac3d7b38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71289f80a05141f482cb538dac3d7b38"}]}] Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-2130542140 Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Tenant-Id: 71289f80a05141f482cb538dac3d7b38 Apr 14 11:07:44 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-2130542140 Apr 14 11:07:44 user devstack@n-api.service[61840]: X-User: tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member Apr 14 11:07:44 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:07:44 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:07:44 user devstack@n-api.service[61840]: X-User-Id: 395bc9d7007c4e01ac7effd418bcea19 Apr 14 11:07:44 user devstack@n-api.service[61840]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member Apr 14 11:07:44 user devstack@n-api.service[61840]: method: > Apr 14 11:07:44 user devstack@n-api.service[61840]: exception: Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 could not be found. Apr 14 11:07:44 user devstack@n-api.service[61840]: action_args: {'id': 'e479154a-acd6-47aa-9a5b-43c6e0feda07'} Apr 14 11:07:44 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 could not be found. Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 could not be found. Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 could not be found. Apr 14 11:07:44 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:07:44 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-4abce0a1-3f16-4089-a889-2d4f851a1f33 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Returning 404 to user: Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:07:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-4abce0a1-3f16-4089-a889-2d4f851a1f33 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07" status: 404 len: 111 microversion: 2.87 time: 0.039526 Apr 14 11:07:44 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 351/1047] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 11:07:44 2023] GET /compute/v2.1/servers/e479154a-acd6-47aa-9a5b-43c6e0feda07 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 11:08:26 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:08:26 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:08:26 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-2f756dec-6e1c-4c7e-9699-10b4dd518a15 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:08:26 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-2f756dec-6e1c-4c7e-9699-10b4dd518a15 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:08:26 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2f756dec-6e1c-4c7e-9699-10b4dd518a15 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:26 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2f756dec-6e1c-4c7e-9699-10b4dd518a15 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:26 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2f756dec-6e1c-4c7e-9699-10b4dd518a15 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:26 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2f756dec-6e1c-4c7e-9699-10b4dd518a15 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:26 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2f756dec-6e1c-4c7e-9699-10b4dd518a15 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:26 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-2f756dec-6e1c-4c7e-9699-10b4dd518a15 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:26 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-2f756dec-6e1c-4c7e-9699-10b4dd518a15 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:08:26 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-2f756dec-6e1c-4c7e-9699-10b4dd518a15 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" status: 200 len: 1378 microversion: 2.1 time: 0.330964 Apr 14 11:08:26 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 353/1048] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:08:26 2023] GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 => generated 1378 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:08:26 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-1a6415fc-0258-4534-bf2c-d0a166e76647 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:08:26 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-1a6415fc-0258-4534-bf2c-d0a166e76647 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:08:26 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:08:26 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=8 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:08:26 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1a6415fc-0258-4534-bf2c-d0a166e76647 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:26 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1a6415fc-0258-4534-bf2c-d0a166e76647 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:26 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1a6415fc-0258-4534-bf2c-d0a166e76647 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:26 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1a6415fc-0258-4534-bf2c-d0a166e76647 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:26 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1a6415fc-0258-4534-bf2c-d0a166e76647 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:26 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-1a6415fc-0258-4534-bf2c-d0a166e76647 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:27 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-1a6415fc-0258-4534-bf2c-d0a166e76647 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:08:27 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-1a6415fc-0258-4534-bf2c-d0a166e76647 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" status: 200 len: 1378 microversion: 2.1 time: 0.255275 Apr 14 11:08:27 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 345/1049] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:08:26 2023] GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 => generated 1378 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:08:27 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:08:27 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:08:27 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:08:27 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:08:27 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:27 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:27 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:27 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:27 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:27 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:27 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Going to try to terminate instance {{(pid=61840) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:08:27 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" status: 204 len: 0 microversion: 2.1 time: 0.117399 Apr 14 11:08:27 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 352/1050] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:08:27 2023] DELETE /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:08:27 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-7b385781-0c2d-4100-bf6d-12f62d6a9039 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:08:27 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-7b385781-0c2d-4100-bf6d-12f62d6a9039 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:08:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7b385781-0c2d-4100-bf6d-12f62d6a9039 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7b385781-0c2d-4100-bf6d-12f62d6a9039 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7b385781-0c2d-4100-bf6d-12f62d6a9039 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7b385781-0c2d-4100-bf6d-12f62d6a9039 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7b385781-0c2d-4100-bf6d-12f62d6a9039 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:27 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7b385781-0c2d-4100-bf6d-12f62d6a9039 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:27 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-7b385781-0c2d-4100-bf6d-12f62d6a9039 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:08:27 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-7b385781-0c2d-4100-bf6d-12f62d6a9039 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" status: 200 len: 1384 microversion: 2.1 time: 0.170527 Apr 14 11:08:27 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 354/1051] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:08:27 2023] GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 => generated 1384 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:08:27 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-6d7d9477-8e30-4c67-875d-3c90d3877585 req-9d0c776b-a78e-48ca-9ce3-18f6546293b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5", "name": "network-vif-unplugged", "status": "completed", "tag": "76a7a337-1fec-4cd0-b065-5788cf59e2da"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:08:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-6d7d9477-8e30-4c67-875d-3c90d3877585 req-9d0c776b-a78e-48ca-9ce3-18f6546293b2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-6d7d9477-8e30-4c67-875d-3c90d3877585 req-9d0c776b-a78e-48ca-9ce3-18f6546293b2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:27 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-6d7d9477-8e30-4c67-875d-3c90d3877585 req-9d0c776b-a78e-48ca-9ce3-18f6546293b2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:27 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-6d7d9477-8e30-4c67-875d-3c90d3877585 req-9d0c776b-a78e-48ca-9ce3-18f6546293b2 service nova] Creating event network-vif-unplugged:76a7a337-1fec-4cd0-b065-5788cf59e2da for instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 on user Apr 14 11:08:27 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-6d7d9477-8e30-4c67-875d-3c90d3877585 req-9d0c776b-a78e-48ca-9ce3-18f6546293b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089857 Apr 14 11:08:27 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 346/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:08:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:08:29 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5", "name": "network-vif-plugged", "status": "completed", "tag": "76a7a337-1fec-4cd0-b065-5788cf59e2da"}, {"server_uuid": "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5", "name": "network-vif-plugged", "status": "completed", "tag": "76a7a337-1fec-4cd0-b065-5788cf59e2da"}, {"server_uuid": "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5", "name": "network-vif-plugged", "status": "completed", "tag": "76a7a337-1fec-4cd0-b065-5788cf59e2da"}, {"server_uuid": "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5", "name": "network-vif-unplugged", "status": "completed", "tag": "76a7a337-1fec-4cd0-b065-5788cf59e2da"}, {"server_uuid": "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5", "name": "network-vif-plugged", "status": "completed", "tag": "76a7a337-1fec-4cd0-b065-5788cf59e2da"}, {"server_uuid": "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5", "name": "network-vif-deleted", "tag": "76a7a337-1fec-4cd0-b065-5788cf59e2da"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:08:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:29 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Creating event network-vif-plugged:76a7a337-1fec-4cd0-b065-5788cf59e2da for instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 on user Apr 14 11:08:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Creating event network-vif-plugged:76a7a337-1fec-4cd0-b065-5788cf59e2da for instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 on user Apr 14 11:08:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Creating event network-vif-plugged:76a7a337-1fec-4cd0-b065-5788cf59e2da for instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 on user Apr 14 11:08:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Creating event network-vif-unplugged:76a7a337-1fec-4cd0-b065-5788cf59e2da for instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 on user Apr 14 11:08:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Creating event network-vif-plugged:76a7a337-1fec-4cd0-b065-5788cf59e2da for instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 on user Apr 14 11:08:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Creating event network-vif-deleted:76a7a337-1fec-4cd0-b065-5788cf59e2da for instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 on user Apr 14 11:08:29 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.032355 Apr 14 11:08:29 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 353/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:08:29 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 11:08:34 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-d31db9d1-19d4-47ae-9415-2fea59c01e98 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:08:34 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-d31db9d1-19d4-47ae-9415-2fea59c01e98 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:08:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d31db9d1-19d4-47ae-9415-2fea59c01e98 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d31db9d1-19d4-47ae-9415-2fea59c01e98 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d31db9d1-19d4-47ae-9415-2fea59c01e98 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d31db9d1-19d4-47ae-9415-2fea59c01e98 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d31db9d1-19d4-47ae-9415-2fea59c01e98 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d31db9d1-19d4-47ae-9415-2fea59c01e98 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:34 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-d31db9d1-19d4-47ae-9415-2fea59c01e98 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:08:34 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-d31db9d1-19d4-47ae-9415-2fea59c01e98 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" status: 200 len: 1536 microversion: 2.1 time: 0.222966 Apr 14 11:08:34 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 355/1054] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:08:34 2023] GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => generated 1536 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:08:34 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-68cfd8a1-282f-4546-850d-d4b5b00962c2 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:08:34 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-68cfd8a1-282f-4546-850d-d4b5b00962c2 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:08:34 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-68cfd8a1-282f-4546-850d-d4b5b00962c2 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Searching by: {'deleted': False, 'project_id': '5809862340a84c83a772c65c77513608'} {{(pid=61839) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 11:08:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-68cfd8a1-282f-4546-850d-d4b5b00962c2 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-68cfd8a1-282f-4546-850d-d4b5b00962c2 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-68cfd8a1-282f-4546-850d-d4b5b00962c2 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-68cfd8a1-282f-4546-850d-d4b5b00962c2 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-68cfd8a1-282f-4546-850d-d4b5b00962c2 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:34 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-68cfd8a1-282f-4546-850d-d4b5b00962c2 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:34 user devstack@n-api.service[61839]: DEBUG nova.compute.multi_cell_list [None req-68cfd8a1-282f-4546-850d-d4b5b00962c2 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61839) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 11:08:35 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-68cfd8a1-282f-4546-850d-d4b5b00962c2 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.274597 Apr 14 11:08:35 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 347/1055] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 11:08:34 2023] GET /compute/v2.1/servers => generated 341 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:08:35 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-a9fc05e5-23b1-4d0b-994b-bdf7ed2c1a8c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:08:35 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-a9fc05e5-23b1-4d0b-994b-bdf7ed2c1a8c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:08:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a9fc05e5-23b1-4d0b-994b-bdf7ed2c1a8c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a9fc05e5-23b1-4d0b-994b-bdf7ed2c1a8c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a9fc05e5-23b1-4d0b-994b-bdf7ed2c1a8c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a9fc05e5-23b1-4d0b-994b-bdf7ed2c1a8c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a9fc05e5-23b1-4d0b-994b-bdf7ed2c1a8c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:35 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-a9fc05e5-23b1-4d0b-994b-bdf7ed2c1a8c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:35 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-a9fc05e5-23b1-4d0b-994b-bdf7ed2c1a8c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:08:35 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-a9fc05e5-23b1-4d0b-994b-bdf7ed2c1a8c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" status: 200 len: 1536 microversion: 2.1 time: 0.238639 Apr 14 11:08:35 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 354/1056] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:08:35 2023] GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => generated 1536 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:08:38 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad9a8e38-a4a0-464f-8ac1-32552aaa2af3"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:08:38 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:08:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:38 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:38 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272229 Apr 14 11:08:38 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 356/1057] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 11:08:38 2023] POST /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:08:46 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-689ce81e-315f-4913-a35d-0721326c3139 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:08:46 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-689ce81e-315f-4913-a35d-0721326c3139 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:08:46 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:08:46 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:08:46 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=16 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:08:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-689ce81e-315f-4913-a35d-0721326c3139 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-689ce81e-315f-4913-a35d-0721326c3139 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-689ce81e-315f-4913-a35d-0721326c3139 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-689ce81e-315f-4913-a35d-0721326c3139 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-689ce81e-315f-4913-a35d-0721326c3139 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-689ce81e-315f-4913-a35d-0721326c3139 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:46 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-689ce81e-315f-4913-a35d-0721326c3139 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:08:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-689ce81e-315f-4913-a35d-0721326c3139 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" status: 200 len: 1582 microversion: 2.1 time: 0.195989 Apr 14 11:08:46 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 348/1058] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:08:46 2023] GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => generated 1582 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:08:47 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-d6c7497e-615a-4b28-8f7c-dbf87b9372d5 req-3862e439-2df9-4966-879f-4dc4769ab6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99", "tag": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:08:47 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:08:47 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:08:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-d6c7497e-615a-4b28-8f7c-dbf87b9372d5 req-3862e439-2df9-4966-879f-4dc4769ab6d6 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-d6c7497e-615a-4b28-8f7c-dbf87b9372d5 req-3862e439-2df9-4966-879f-4dc4769ab6d6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:47 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-d6c7497e-615a-4b28-8f7c-dbf87b9372d5 req-3862e439-2df9-4966-879f-4dc4769ab6d6 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:47 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-d6c7497e-615a-4b28-8f7c-dbf87b9372d5 req-3862e439-2df9-4966-879f-4dc4769ab6d6 service nova] Creating event network-changed:cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 on user Apr 14 11:08:47 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-d6c7497e-615a-4b28-8f7c-dbf87b9372d5 req-3862e439-2df9-4966-879f-4dc4769ab6d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041822 Apr 14 11:08:47 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 355/1059] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:08:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:08:49 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-3674d17b-9ddf-4ab3-8798-222cc8b05c0c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-134841711"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:08:49 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-3674d17b-9ddf-4ab3-8798-222cc8b05c0c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:08:49 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=8 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:08:49 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:08:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3674d17b-9ddf-4ab3-8798-222cc8b05c0c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3674d17b-9ddf-4ab3-8798-222cc8b05c0c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3674d17b-9ddf-4ab3-8798-222cc8b05c0c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3674d17b-9ddf-4ab3-8798-222cc8b05c0c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3674d17b-9ddf-4ab3-8798-222cc8b05c0c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:49 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-3674d17b-9ddf-4ab3-8798-222cc8b05c0c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:49 user devstack@n-api.service[61841]: INFO nova.network.security_group_api [None req-3674d17b-9ddf-4ab3-8798-222cc8b05c0c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Adding security group b3aad4a8-5579-41b5-8b0d-1c162bc94522 to port cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 Apr 14 11:08:49 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-3674d17b-9ddf-4ab3-8798-222cc8b05c0c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/action" status: 202 len: 0 microversion: 2.1 time: 0.571354 Apr 14 11:08:49 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 357/1060] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 11:08:49 2023] POST /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:08:49 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-3154c407-8978-4ae5-8cc3-09fdac934155 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:08:49 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-3154c407-8978-4ae5-8cc3-09fdac934155 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:08:49 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-26c5cbfd-41ae-4841-bd77-5e35dfe3c2b2 req-374eec00-33b7-4c30-a2e2-3c42b951227f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99", "tag": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:08:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3154c407-8978-4ae5-8cc3-09fdac934155 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3154c407-8978-4ae5-8cc3-09fdac934155 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3154c407-8978-4ae5-8cc3-09fdac934155 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3154c407-8978-4ae5-8cc3-09fdac934155 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3154c407-8978-4ae5-8cc3-09fdac934155 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:49 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-3154c407-8978-4ae5-8cc3-09fdac934155 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-26c5cbfd-41ae-4841-bd77-5e35dfe3c2b2 req-374eec00-33b7-4c30-a2e2-3c42b951227f service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-26c5cbfd-41ae-4841-bd77-5e35dfe3c2b2 req-374eec00-33b7-4c30-a2e2-3c42b951227f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-26c5cbfd-41ae-4841-bd77-5e35dfe3c2b2 req-374eec00-33b7-4c30-a2e2-3c42b951227f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-26c5cbfd-41ae-4841-bd77-5e35dfe3c2b2 req-374eec00-33b7-4c30-a2e2-3c42b951227f service nova] Creating event network-changed:cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 on user Apr 14 11:08:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-26c5cbfd-41ae-4841-bd77-5e35dfe3c2b2 req-374eec00-33b7-4c30-a2e2-3c42b951227f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033021 Apr 14 11:08:49 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 356/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:08:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:08:50 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-3154c407-8978-4ae5-8cc3-09fdac934155 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:08:50 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-3154c407-8978-4ae5-8cc3-09fdac934155 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" status: 200 len: 1747 microversion: 2.1 time: 0.220187 Apr 14 11:08:50 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 349/1062] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:08:49 2023] GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => generated 1747 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:08:50 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:08:50 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:08:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/action" status: 202 len: 0 microversion: 2.1 time: 0.089132 Apr 14 11:08:50 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 358/1063] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 11:08:50 2023] POST /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:08:50 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-9fe6a99d-1974-4372-a725-69b234d6aa6a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:08:50 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-9fe6a99d-1974-4372-a725-69b234d6aa6a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:08:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-9fe6a99d-1974-4372-a725-69b234d6aa6a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-9fe6a99d-1974-4372-a725-69b234d6aa6a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-9fe6a99d-1974-4372-a725-69b234d6aa6a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-9fe6a99d-1974-4372-a725-69b234d6aa6a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-9fe6a99d-1974-4372-a725-69b234d6aa6a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-9fe6a99d-1974-4372-a725-69b234d6aa6a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:50 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-9fe6a99d-1974-4372-a725-69b234d6aa6a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:08:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-9fe6a99d-1974-4372-a725-69b234d6aa6a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" status: 200 len: 1739 microversion: 2.1 time: 0.196035 Apr 14 11:08:50 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 357/1064] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:08:50 2023] GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:08:53 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-82b3581a-1a66-45f4-b1a6-9b59ad9f6dfb req-ab5f3ead-246e-4f50-b0d4-f7f9b88d533f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99", "name": "network-vif-unplugged", "status": "completed", "tag": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:08:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-82b3581a-1a66-45f4-b1a6-9b59ad9f6dfb req-ab5f3ead-246e-4f50-b0d4-f7f9b88d533f service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-82b3581a-1a66-45f4-b1a6-9b59ad9f6dfb req-ab5f3ead-246e-4f50-b0d4-f7f9b88d533f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-82b3581a-1a66-45f4-b1a6-9b59ad9f6dfb req-ab5f3ead-246e-4f50-b0d4-f7f9b88d533f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:53 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-82b3581a-1a66-45f4-b1a6-9b59ad9f6dfb req-ab5f3ead-246e-4f50-b0d4-f7f9b88d533f service nova] Creating event network-vif-unplugged:cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 on user Apr 14 11:08:53 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-82b3581a-1a66-45f4-b1a6-9b59ad9f6dfb req-ab5f3ead-246e-4f50-b0d4-f7f9b88d533f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.180414 Apr 14 11:08:53 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 350/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:08:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:08:55 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99", "name": "network-vif-plugged", "status": "completed", "tag": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608"}, {"server_uuid": "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99", "name": "network-vif-plugged", "status": "completed", "tag": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:08:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:55 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:55 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] Creating event network-vif-plugged:cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 on user Apr 14 11:08:55 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] Creating event network-vif-plugged:cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 on user Apr 14 11:08:55 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047728 Apr 14 11:08:55 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 359/1066] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:08:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:08:57 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-fb1d8642-66e7-4d81-b869-173de51874a3 req-f9e1cc64-c14c-4cac-a9de-95854e311728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99", "name": "network-vif-plugged", "status": "completed", "tag": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:08:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-fb1d8642-66e7-4d81-b869-173de51874a3 req-f9e1cc64-c14c-4cac-a9de-95854e311728 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:08:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-fb1d8642-66e7-4d81-b869-173de51874a3 req-f9e1cc64-c14c-4cac-a9de-95854e311728 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:08:57 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-fb1d8642-66e7-4d81-b869-173de51874a3 req-f9e1cc64-c14c-4cac-a9de-95854e311728 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:08:57 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-fb1d8642-66e7-4d81-b869-173de51874a3 req-f9e1cc64-c14c-4cac-a9de-95854e311728 service nova] Creating event network-vif-plugged:cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 on user Apr 14 11:08:57 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-fb1d8642-66e7-4d81-b869-173de51874a3 req-f9e1cc64-c14c-4cac-a9de-95854e311728 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030972 Apr 14 11:08:57 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 358/1067] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:08:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 11:09:17 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:09:17 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=14 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:09:17 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-36f222d1-deab-46cd-a0c1-531c93ffa20a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:09:17 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-36f222d1-deab-46cd-a0c1-531c93ffa20a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:09:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-36f222d1-deab-46cd-a0c1-531c93ffa20a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:09:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-36f222d1-deab-46cd-a0c1-531c93ffa20a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:09:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-36f222d1-deab-46cd-a0c1-531c93ffa20a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:09:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-36f222d1-deab-46cd-a0c1-531c93ffa20a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:09:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-36f222d1-deab-46cd-a0c1-531c93ffa20a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:09:17 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-36f222d1-deab-46cd-a0c1-531c93ffa20a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:09:17 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-36f222d1-deab-46cd-a0c1-531c93ffa20a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HTTP exception thrown: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. Apr 14 11:09:17 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-36f222d1-deab-46cd-a0c1-531c93ffa20a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Request method failure captured: Apr 14 11:09:17 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 HTTP/1.1 Apr 14 11:09:17 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:09:17 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:09:17 user devstack@n-api.service[61839]: Connection: close Apr 14 11:09:17 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:09:17 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:09:17 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:09:17 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:09:17 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:09:17 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTOscq830xumO0pE4afr8hOrEKJzznUYbYP-3SI3ny-DA6kv_rRe3G7iAHsQdncX43dMQiRCf9NWDRZowvTbgHtZlJuzDm2z8bxhcIzBRIAVlefTNB4nKwb-zSZ6OMRbbxZzKV1NmP0nkTSlvsXvb4bIOP4rVsUvjkb-NM520Xm7GX4 Apr 14 11:09:17 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:09:17 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:09:17 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:09:17 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:09:17 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:09:17 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:09:17 user devstack@n-api.service[61839]: X-Project-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:09:17 user devstack@n-api.service[61839]: X-Project-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:09:17 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:09:17 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:09:17 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}] Apr 14 11:09:17 user devstack@n-api.service[61839]: X-Tenant: tempest-TestVolumeBootPattern-193101874 Apr 14 11:09:17 user devstack@n-api.service[61839]: X-Tenant-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:09:17 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:09:17 user devstack@n-api.service[61839]: X-User: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:09:17 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:09:17 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:09:17 user devstack@n-api.service[61839]: X-User-Id: c7644d02bc784e4fb74ebaaceb3affe1 Apr 14 11:09:17 user devstack@n-api.service[61839]: X-User-Name: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:09:17 user devstack@n-api.service[61839]: method: > Apr 14 11:09:17 user devstack@n-api.service[61839]: exception: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. Apr 14 11:09:17 user devstack@n-api.service[61839]: action_args: {'id': '1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5'} Apr 14 11:09:17 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. Apr 14 11:09:17 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:09:17 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-36f222d1-deab-46cd-a0c1-531c93ffa20a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Returning 404 to user: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:09:17 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-36f222d1-deab-46cd-a0c1-531c93ffa20a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" status: 404 len: 111 microversion: 2.1 time: 0.031524 Apr 14 11:09:17 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 351/1068] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:09:17 2023] GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:09:17 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:09:17 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:09:17 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-8ee95894-6299-4f16-8ba7-4ae7fe3819cb tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:09:17 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-8ee95894-6299-4f16-8ba7-4ae7fe3819cb tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:09:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8ee95894-6299-4f16-8ba7-4ae7fe3819cb tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:09:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8ee95894-6299-4f16-8ba7-4ae7fe3819cb tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:09:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8ee95894-6299-4f16-8ba7-4ae7fe3819cb tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:09:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8ee95894-6299-4f16-8ba7-4ae7fe3819cb tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:09:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8ee95894-6299-4f16-8ba7-4ae7fe3819cb tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:09:17 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-8ee95894-6299-4f16-8ba7-4ae7fe3819cb tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:09:17 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-8ee95894-6299-4f16-8ba7-4ae7fe3819cb tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HTTP exception thrown: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. Apr 14 11:09:17 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-8ee95894-6299-4f16-8ba7-4ae7fe3819cb tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Request method failure captured: Apr 14 11:09:17 user devstack@n-api.service[61841]: request: DELETE /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 HTTP/1.1 Apr 14 11:09:17 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:09:17 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:09:17 user devstack@n-api.service[61841]: Connection: close Apr 14 11:09:17 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:09:17 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:09:17 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:09:17 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:09:17 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:09:17 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOTOscq830xumO0pE4afr8hOrEKJzznUYbYP-3SI3ny-DA6kv_rRe3G7iAHsQdncX43dMQiRCf9NWDRZowvTbgHtZlJuzDm2z8bxhcIzBRIAVlefTNB4nKwb-zSZ6OMRbbxZzKV1NmP0nkTSlvsXvb4bIOP4rVsUvjkb-NM520Xm7GX4 Apr 14 11:09:17 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:09:17 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:09:17 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:09:17 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:09:17 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:09:17 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:09:17 user devstack@n-api.service[61841]: X-Project-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:09:17 user devstack@n-api.service[61841]: X-Project-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:09:17 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:09:17 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:09:17 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}] Apr 14 11:09:17 user devstack@n-api.service[61841]: X-Tenant: tempest-TestVolumeBootPattern-193101874 Apr 14 11:09:17 user devstack@n-api.service[61841]: X-Tenant-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:09:17 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:09:17 user devstack@n-api.service[61841]: X-User: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:09:17 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:09:17 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:09:17 user devstack@n-api.service[61841]: X-User-Id: c7644d02bc784e4fb74ebaaceb3affe1 Apr 14 11:09:17 user devstack@n-api.service[61841]: X-User-Name: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:09:17 user devstack@n-api.service[61841]: method: > Apr 14 11:09:17 user devstack@n-api.service[61841]: exception: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. Apr 14 11:09:17 user devstack@n-api.service[61841]: action_args: {'id': '1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5'} Apr 14 11:09:17 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. Apr 14 11:09:17 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:09:17 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-8ee95894-6299-4f16-8ba7-4ae7fe3819cb tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Returning 404 to user: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:09:17 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-8ee95894-6299-4f16-8ba7-4ae7fe3819cb tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" status: 404 len: 111 microversion: 2.1 time: 0.035630 Apr 14 11:09:17 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 360/1069] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:09:17 2023] DELETE /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:09:17 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=8 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:09:17 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=12 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:09:17 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-aba89fae-0798-4483-9fa3-822d94439479 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:09:17 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-aba89fae-0798-4483-9fa3-822d94439479 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:09:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aba89fae-0798-4483-9fa3-822d94439479 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:09:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aba89fae-0798-4483-9fa3-822d94439479 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:09:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aba89fae-0798-4483-9fa3-822d94439479 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:09:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aba89fae-0798-4483-9fa3-822d94439479 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:09:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aba89fae-0798-4483-9fa3-822d94439479 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:09:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-aba89fae-0798-4483-9fa3-822d94439479 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:09:17 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-aba89fae-0798-4483-9fa3-822d94439479 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HTTP exception thrown: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. Apr 14 11:09:17 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-aba89fae-0798-4483-9fa3-822d94439479 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Request method failure captured: Apr 14 11:09:17 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 HTTP/1.1 Apr 14 11:09:17 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:09:17 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:09:17 user devstack@n-api.service[61840]: Connection: close Apr 14 11:09:17 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:09:17 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:09:17 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:09:17 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:09:17 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:09:17 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTOscq830xumO0pE4afr8hOrEKJzznUYbYP-3SI3ny-DA6kv_rRe3G7iAHsQdncX43dMQiRCf9NWDRZowvTbgHtZlJuzDm2z8bxhcIzBRIAVlefTNB4nKwb-zSZ6OMRbbxZzKV1NmP0nkTSlvsXvb4bIOP4rVsUvjkb-NM520Xm7GX4 Apr 14 11:09:17 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:09:17 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:09:17 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:09:17 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:09:17 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:09:17 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:09:17 user devstack@n-api.service[61840]: X-Project-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:09:17 user devstack@n-api.service[61840]: X-Project-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:09:17 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:09:17 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:09:17 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}] Apr 14 11:09:17 user devstack@n-api.service[61840]: X-Tenant: tempest-TestVolumeBootPattern-193101874 Apr 14 11:09:17 user devstack@n-api.service[61840]: X-Tenant-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:09:17 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:09:17 user devstack@n-api.service[61840]: X-User: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:09:17 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:09:17 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:09:17 user devstack@n-api.service[61840]: X-User-Id: c7644d02bc784e4fb74ebaaceb3affe1 Apr 14 11:09:17 user devstack@n-api.service[61840]: X-User-Name: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:09:17 user devstack@n-api.service[61840]: method: > Apr 14 11:09:17 user devstack@n-api.service[61840]: exception: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. Apr 14 11:09:17 user devstack@n-api.service[61840]: action_args: {'id': '1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5'} Apr 14 11:09:17 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. Apr 14 11:09:17 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:09:17 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-aba89fae-0798-4483-9fa3-822d94439479 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Returning 404 to user: Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:09:17 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-aba89fae-0798-4483-9fa3-822d94439479 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" status: 404 len: 111 microversion: 2.1 time: 0.034644 Apr 14 11:09:17 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 359/1070] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:09:17 2023] GET /compute/v2.1/servers/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1989339962", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "b6eae10c-5695-41f5-8511-7a5bbc598367", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32"}]}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG nova.network.neutron [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] validate_networks() for [('6d6b6b35-b5ef-4d7c-abce-cad21cc99e32', None, None, None, None, None)] {{(pid=61839) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image limits 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image pref 0:0:0 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61839) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting quotas for project 2e7089cb52574f1daf7f578222bb7a67. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting quotas for user c7644d02bc784e4fb74ebaaceb3affe1 and project 2e7089cb52574f1daf7f578222bb7a67. Resources: {'cores', 'instances', 'ram'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Going to run 1 instances... {{(pid=61839) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:09:29 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b6eae10c-5695-41f5-8511-7a5bbc598367',volume_size=None,volume_type=None)] {{(pid=61839) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:09:29 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.883889 Apr 14 11:09:29 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 352/1071] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:09:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:09:29 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-d69f2ae2-41ba-4170-ac67-7a6fdbaed877 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:09:29 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-d69f2ae2-41ba-4170-ac67-7a6fdbaed877 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:09:29 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:09:30 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-d69f2ae2-41ba-4170-ac67-7a6fdbaed877 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:09:30 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-d69f2ae2-41ba-4170-ac67-7a6fdbaed877 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91" status: 200 len: 1066 microversion: 2.1 time: 0.088143 Apr 14 11:09:30 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 361/1072] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:09:29 2023] GET /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91 => generated 1066 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:09:32 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-619c7b7b-159f-4ca9-b15d-eccde659efe4 req-612a81e1-7d17-4703-b978-9e55714a5853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "434ec83b-ca3c-446e-a63b-f130ceaf8e91", "tag": "dd3954c8-cff9-4d50-a4bb-63365524ac72"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:09:32 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:09:32 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:09:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-619c7b7b-159f-4ca9-b15d-eccde659efe4 req-612a81e1-7d17-4703-b978-9e55714a5853 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:09:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-619c7b7b-159f-4ca9-b15d-eccde659efe4 req-612a81e1-7d17-4703-b978-9e55714a5853 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:09:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-619c7b7b-159f-4ca9-b15d-eccde659efe4 req-612a81e1-7d17-4703-b978-9e55714a5853 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:09:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-619c7b7b-159f-4ca9-b15d-eccde659efe4 req-612a81e1-7d17-4703-b978-9e55714a5853 service nova] Creating event network-changed:dd3954c8-cff9-4d50-a4bb-63365524ac72 for instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 on user Apr 14 11:09:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-619c7b7b-159f-4ca9-b15d-eccde659efe4 req-612a81e1-7d17-4703-b978-9e55714a5853 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041314 Apr 14 11:09:32 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 360/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:09:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:09:39 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-569613c2-97b7-43c8-a8fa-57735bed57d0 req-41f882b7-1d03-4b93-8271-94dc17f76b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "434ec83b-ca3c-446e-a63b-f130ceaf8e91", "name": "network-vif-plugged", "status": "completed", "tag": "dd3954c8-cff9-4d50-a4bb-63365524ac72"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:09:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-569613c2-97b7-43c8-a8fa-57735bed57d0 req-41f882b7-1d03-4b93-8271-94dc17f76b12 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:09:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-569613c2-97b7-43c8-a8fa-57735bed57d0 req-41f882b7-1d03-4b93-8271-94dc17f76b12 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:09:39 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-569613c2-97b7-43c8-a8fa-57735bed57d0 req-41f882b7-1d03-4b93-8271-94dc17f76b12 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:09:39 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-569613c2-97b7-43c8-a8fa-57735bed57d0 req-41f882b7-1d03-4b93-8271-94dc17f76b12 service nova] Creating event network-vif-plugged:dd3954c8-cff9-4d50-a4bb-63365524ac72 for instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 on user Apr 14 11:09:39 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-569613c2-97b7-43c8-a8fa-57735bed57d0 req-41f882b7-1d03-4b93-8271-94dc17f76b12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043502 Apr 14 11:09:39 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 353/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:09:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:09:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-5fd5806f-ed08-4374-9560-121247ef3e5a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:09:40 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-5fd5806f-ed08-4374-9560-121247ef3e5a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:09:40 user devstack@n-api.service[61841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 11:09:40 user devstack@n-api.service[61841]: Fri Apr 14 11:09:40 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 (ip 10.0.0.210) !!! Apr 14 11:09:40 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:09:40 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:09:40 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:09:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5fd5806f-ed08-4374-9560-121247ef3e5a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:09:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5fd5806f-ed08-4374-9560-121247ef3e5a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:09:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5fd5806f-ed08-4374-9560-121247ef3e5a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:09:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5fd5806f-ed08-4374-9560-121247ef3e5a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:09:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5fd5806f-ed08-4374-9560-121247ef3e5a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:09:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5fd5806f-ed08-4374-9560-121247ef3e5a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:09:40 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-5fd5806f-ed08-4374-9560-121247ef3e5a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:09:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-5fd5806f-ed08-4374-9560-121247ef3e5a tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" status: 200 len: 1747 microversion: 2.1 time: 0.177735 Apr 14 11:09:40 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 362/1075] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:09:40 2023] GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => generated 1747 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:09:41 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-cee2edbb-1e6c-46a7-9030-a8bb0b4b63eb req-efdb2a92-2295-4e5e-9d05-db110f5ff0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "434ec83b-ca3c-446e-a63b-f130ceaf8e91", "name": "network-vif-plugged", "status": "completed", "tag": "dd3954c8-cff9-4d50-a4bb-63365524ac72"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:09:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-cee2edbb-1e6c-46a7-9030-a8bb0b4b63eb req-efdb2a92-2295-4e5e-9d05-db110f5ff0f5 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:09:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-cee2edbb-1e6c-46a7-9030-a8bb0b4b63eb req-efdb2a92-2295-4e5e-9d05-db110f5ff0f5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:09:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-cee2edbb-1e6c-46a7-9030-a8bb0b4b63eb req-efdb2a92-2295-4e5e-9d05-db110f5ff0f5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:09:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-cee2edbb-1e6c-46a7-9030-a8bb0b4b63eb req-efdb2a92-2295-4e5e-9d05-db110f5ff0f5 service nova] Creating event network-vif-plugged:dd3954c8-cff9-4d50-a4bb-63365524ac72 for instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 on user Apr 14 11:09:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-cee2edbb-1e6c-46a7-9030-a8bb0b4b63eb req-efdb2a92-2295-4e5e-9d05-db110f5ff0f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054739 Apr 14 11:09:41 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 361/1076] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:09:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:10:20 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:10:20 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:10:20 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:10:20 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:10:20 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-c78b2534-a9a5-4975-8bfc-c25a5a24f16e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:10:20 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-c78b2534-a9a5-4975-8bfc-c25a5a24f16e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:10:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c78b2534-a9a5-4975-8bfc-c25a5a24f16e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:10:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c78b2534-a9a5-4975-8bfc-c25a5a24f16e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:10:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c78b2534-a9a5-4975-8bfc-c25a5a24f16e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:10:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c78b2534-a9a5-4975-8bfc-c25a5a24f16e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:10:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c78b2534-a9a5-4975-8bfc-c25a5a24f16e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:10:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-c78b2534-a9a5-4975-8bfc-c25a5a24f16e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:10:20 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-c78b2534-a9a5-4975-8bfc-c25a5a24f16e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:10:20 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-c78b2534-a9a5-4975-8bfc-c25a5a24f16e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91" status: 200 len: 1392 microversion: 2.1 time: 0.190927 Apr 14 11:10:20 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 354/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:10:20 2023] GET /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91 => generated 1392 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:10:40 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:10:40 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:10:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-05281606-bcc2-458e-a2ae-bce716fbe4bf tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-134841711"}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:10:40 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-05281606-bcc2-458e-a2ae-bce716fbe4bf tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:10:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-05281606-bcc2-458e-a2ae-bce716fbe4bf tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:10:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-05281606-bcc2-458e-a2ae-bce716fbe4bf tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:10:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-05281606-bcc2-458e-a2ae-bce716fbe4bf tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:10:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-05281606-bcc2-458e-a2ae-bce716fbe4bf tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:10:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-05281606-bcc2-458e-a2ae-bce716fbe4bf tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:10:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-05281606-bcc2-458e-a2ae-bce716fbe4bf tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:10:41 user devstack@n-api.service[61841]: INFO nova.network.security_group_api [None req-05281606-bcc2-458e-a2ae-bce716fbe4bf tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Removing security group b3aad4a8-5579-41b5-8b0d-1c162bc94522 from port cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 Apr 14 11:10:41 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-05281606-bcc2-458e-a2ae-bce716fbe4bf tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/action" status: 202 len: 0 microversion: 2.1 time: 0.648214 Apr 14 11:10:41 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 363/1078] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 11:10:40 2023] POST /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:10:41 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:10:41 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:10:41 user devstack@n-api.service[61840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 11:10:41 user devstack@n-api.service[61840]: Fri Apr 14 11:10:41 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 11:10:41 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-fe6f9aec-660c-4c2b-a8d6-366b82c005a0 req-5d4486dd-b773-4f71-81a1-cdd92dfdf24a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99", "tag": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:10:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-fe6f9aec-660c-4c2b-a8d6-366b82c005a0 req-5d4486dd-b773-4f71-81a1-cdd92dfdf24a service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:10:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-fe6f9aec-660c-4c2b-a8d6-366b82c005a0 req-5d4486dd-b773-4f71-81a1-cdd92dfdf24a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:10:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-fe6f9aec-660c-4c2b-a8d6-366b82c005a0 req-5d4486dd-b773-4f71-81a1-cdd92dfdf24a service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:10:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-fe6f9aec-660c-4c2b-a8d6-366b82c005a0 req-5d4486dd-b773-4f71-81a1-cdd92dfdf24a service nova] Creating event network-changed:cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 on user Apr 14 11:10:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-fe6f9aec-660c-4c2b-a8d6-366b82c005a0 req-5d4486dd-b773-4f71-81a1-cdd92dfdf24a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.254224 Apr 14 11:10:41 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 362/1079] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:10:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:10:42 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:10:42 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:10:42 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:10:42 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:10:42 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-02d43780-3469-4b27-9b6e-43f81ac403da req-c50ec026-8394-4549-84e8-0541f0bdf267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99", "tag": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:10:42 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:10:42 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:10:42 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:10:42 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:10:42 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:10:42 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:10:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-02d43780-3469-4b27-9b6e-43f81ac403da req-c50ec026-8394-4549-84e8-0541f0bdf267 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:10:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-02d43780-3469-4b27-9b6e-43f81ac403da req-c50ec026-8394-4549-84e8-0541f0bdf267 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:10:42 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-02d43780-3469-4b27-9b6e-43f81ac403da req-c50ec026-8394-4549-84e8-0541f0bdf267 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:10:42 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-02d43780-3469-4b27-9b6e-43f81ac403da req-c50ec026-8394-4549-84e8-0541f0bdf267 service nova] Creating event network-changed:cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 on user Apr 14 11:10:42 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-02d43780-3469-4b27-9b6e-43f81ac403da req-c50ec026-8394-4549-84e8-0541f0bdf267 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032015 Apr 14 11:10:42 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 364/1080] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:10:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:10:42 user devstack@n-api.service[61839]: DEBUG nova.objects.instance [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'services' on Instance uuid 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 {{(pid=61839) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 11:10:42 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/os-volume_attachments/ad9a8e38-a4a0-464f-8ac1-32552aaa2af3" status: 202 len: 0 microversion: 2.1 time: 0.170077 Apr 14 11:10:42 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 355/1081] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 11:10:42 2023] DELETE /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/os-volume_attachments/ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:10:42 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-d6ea9447-74e9-4fcb-be5b-fd8931224596 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:10:42 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-d6ea9447-74e9-4fcb-be5b-fd8931224596 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:10:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d6ea9447-74e9-4fcb-be5b-fd8931224596 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:10:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d6ea9447-74e9-4fcb-be5b-fd8931224596 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:10:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d6ea9447-74e9-4fcb-be5b-fd8931224596 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:10:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d6ea9447-74e9-4fcb-be5b-fd8931224596 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:10:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d6ea9447-74e9-4fcb-be5b-fd8931224596 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:10:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-d6ea9447-74e9-4fcb-be5b-fd8931224596 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:10:42 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-d6ea9447-74e9-4fcb-be5b-fd8931224596 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059447 Apr 14 11:10:42 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 363/1082] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:10:42 2023] GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:11:20 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:11:20 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:11:20 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-63fb0628-afdd-4ce5-b67e-9005ee1fc398 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:11:20 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-63fb0628-afdd-4ce5-b67e-9005ee1fc398 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:11:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-63fb0628-afdd-4ce5-b67e-9005ee1fc398 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-63fb0628-afdd-4ce5-b67e-9005ee1fc398 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-63fb0628-afdd-4ce5-b67e-9005ee1fc398 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-63fb0628-afdd-4ce5-b67e-9005ee1fc398 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-63fb0628-afdd-4ce5-b67e-9005ee1fc398 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:20 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-63fb0628-afdd-4ce5-b67e-9005ee1fc398 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:20 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-63fb0628-afdd-4ce5-b67e-9005ee1fc398 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:11:20 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-63fb0628-afdd-4ce5-b67e-9005ee1fc398 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91" status: 200 len: 1392 microversion: 2.1 time: 0.166095 Apr 14 11:11:20 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 365/1083] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:11:20 2023] GET /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:11:20 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:11:20 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:11:20 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-a742cb99-ad28-41ee-beee-66baf169a24c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-935320189"}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:11:20 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-a742cb99-ad28-41ee-beee-66baf169a24c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:11:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a742cb99-ad28-41ee-beee-66baf169a24c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a742cb99-ad28-41ee-beee-66baf169a24c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a742cb99-ad28-41ee-beee-66baf169a24c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a742cb99-ad28-41ee-beee-66baf169a24c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a742cb99-ad28-41ee-beee-66baf169a24c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:20 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-a742cb99-ad28-41ee-beee-66baf169a24c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:20 user devstack@n-api.service[61839]: INFO nova.compute.api [None req-a742cb99-ad28-41ee-beee-66baf169a24c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Attempting to quiesce instance before volume snapshot. Apr 14 11:11:20 user devstack@n-api.service[61839]: INFO nova.compute.api [None req-a742cb99-ad28-41ee-beee-66baf169a24c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 14 11:11:20 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-a742cb99-ad28-41ee-beee-66baf169a24c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Creating snapshot from volume b6eae10c-5695-41f5-8511-7a5bbc598367. {{(pid=61839) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 14 11:11:23 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-a742cb99-ad28-41ee-beee-66baf169a24c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "POST /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91/action" status: 202 len: 0 microversion: 2.1 time: 2.497422 Apr 14 11:11:23 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 356/1084] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 11:11:20 2023] POST /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91/action => generated 0 bytes in 2499 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1443395603", "imageRef": "93ab939e-5ede-4edd-aa21-6e6ce2e27bdb", "flavorRef": "42", "networks": [{"uuid": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32"}]}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=8 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] validate_networks() for [('6d6b6b35-b5ef-4d7c-abce-cad21cc99e32', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting quotas for project 2e7089cb52574f1daf7f578222bb7a67. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting quotas for user c7644d02bc784e4fb74ebaaceb3affe1 and project 2e7089cb52574f1daf7f578222bb7a67. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:11:23 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a25d2fe8-6c54-458b-9ff0-e8dc47483640',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:11:23 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.620394 Apr 14 11:11:23 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 364/1085] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:11:23 2023] POST /compute/v2.1/servers => generated 378 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:11:23 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-700286b5-4abe-477e-b524-fbfc2041e1ac tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:11:23 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-700286b5-4abe-477e-b524-fbfc2041e1ac tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:11:23 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-700286b5-4abe-477e-b524-fbfc2041e1ac tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:11:23 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-700286b5-4abe-477e-b524-fbfc2041e1ac tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584" status: 200 len: 1224 microversion: 2.1 time: 0.065945 Apr 14 11:11:23 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 366/1086] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:11:23 2023] GET /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584 => generated 1224 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:11:26 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-5fd0d068-d504-46c7-820a-493643e9177b req-ddf3fbe7-ca1a-4e7a-83cc-5a2d2529d032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f86738b-0091-4be9-bd1f-729e54374584", "tag": "6d4702fa-9e35-4be4-b3b9-015af3cddba8"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:11:26 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-5fd0d068-d504-46c7-820a-493643e9177b req-ddf3fbe7-ca1a-4e7a-83cc-5a2d2529d032 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:26 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-5fd0d068-d504-46c7-820a-493643e9177b req-ddf3fbe7-ca1a-4e7a-83cc-5a2d2529d032 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:26 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-5fd0d068-d504-46c7-820a-493643e9177b req-ddf3fbe7-ca1a-4e7a-83cc-5a2d2529d032 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:26 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-5fd0d068-d504-46c7-820a-493643e9177b req-ddf3fbe7-ca1a-4e7a-83cc-5a2d2529d032 service nova] Creating event network-changed:6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance 3f86738b-0091-4be9-bd1f-729e54374584 on user Apr 14 11:11:26 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-5fd0d068-d504-46c7-820a-493643e9177b req-ddf3fbe7-ca1a-4e7a-83cc-5a2d2529d032 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033243 Apr 14 11:11:26 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 357/1087] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:11:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:11:32 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-13216992-44b2-4d64-a8c1-cbe923aa94ee tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:11:32 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-13216992-44b2-4d64-a8c1-cbe923aa94ee tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:11:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-13216992-44b2-4d64-a8c1-cbe923aa94ee tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-13216992-44b2-4d64-a8c1-cbe923aa94ee tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-13216992-44b2-4d64-a8c1-cbe923aa94ee tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-13216992-44b2-4d64-a8c1-cbe923aa94ee tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-13216992-44b2-4d64-a8c1-cbe923aa94ee tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-13216992-44b2-4d64-a8c1-cbe923aa94ee tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-13216992-44b2-4d64-a8c1-cbe923aa94ee tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.203596 Apr 14 11:11:32 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 365/1088] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 11:11:32 2023] GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/os-volume_attachments => generated 25 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 11:11:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-f8fb046a-fc91-4aab-ba40-2d552e6a604b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:11:32 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-f8fb046a-fc91-4aab-ba40-2d552e6a604b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:11:32 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:11:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f8fb046a-fc91-4aab-ba40-2d552e6a604b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f8fb046a-fc91-4aab-ba40-2d552e6a604b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f8fb046a-fc91-4aab-ba40-2d552e6a604b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f8fb046a-fc91-4aab-ba40-2d552e6a604b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f8fb046a-fc91-4aab-ba40-2d552e6a604b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:32 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f8fb046a-fc91-4aab-ba40-2d552e6a604b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:32 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-f8fb046a-fc91-4aab-ba40-2d552e6a604b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] HTTP exception thrown: Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 is not attached to volume ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 Apr 14 11:11:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-f8fb046a-fc91-4aab-ba40-2d552e6a604b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Request method failure captured: Apr 14 11:11:32 user devstack@n-api.service[61841]: request: DELETE /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/os-volume_attachments/ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 HTTP/1.1 Apr 14 11:11:32 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:11:32 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:11:32 user devstack@n-api.service[61841]: Connection: close Apr 14 11:11:32 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:11:32 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:11:32 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:11:32 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:11:32 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:11:32 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOTJW_nWg2J6o5vRSemm_jlYLT0-S7Yb4P258bLmZ_oKhu6WwoM645orauyJVaZxPKqfOe3071SM1yQhGISaiJoewlLZV_YCsGerTXcSPWKP8ETj9kSKFH3ym18ac0vy24ipdNhiqubWRNnQNGdXbdJml0bR5LRKX7PzbHlt-bdy21fA Apr 14 11:11:32 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:11:32 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:11:32 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:11:32 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:11:32 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:11:32 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:11:32 user devstack@n-api.service[61841]: X-Project-Id: 5809862340a84c83a772c65c77513608 Apr 14 11:11:32 user devstack@n-api.service[61841]: X-Project-Name: tempest-TestMinimumBasicScenario-2127394977 Apr 14 11:11:32 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:11:32 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:11:32 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5809862340a84c83a772c65c77513608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5809862340a84c83a772c65c77513608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5809862340a84c83a772c65c77513608"}]}] Apr 14 11:11:32 user devstack@n-api.service[61841]: X-Tenant: tempest-TestMinimumBasicScenario-2127394977 Apr 14 11:11:32 user devstack@n-api.service[61841]: X-Tenant-Id: 5809862340a84c83a772c65c77513608 Apr 14 11:11:32 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2127394977 Apr 14 11:11:32 user devstack@n-api.service[61841]: X-User: tempest-TestMinimumBasicScenario-2127394977-project-member Apr 14 11:11:32 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:11:32 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:11:32 user devstack@n-api.service[61841]: X-User-Id: 831215baa8fd4fe7ba65193bbbdad1b4 Apr 14 11:11:32 user devstack@n-api.service[61841]: X-User-Name: tempest-TestMinimumBasicScenario-2127394977-project-member Apr 14 11:11:32 user devstack@n-api.service[61841]: method: > Apr 14 11:11:32 user devstack@n-api.service[61841]: exception: Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 is not attached to volume ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 Apr 14 11:11:32 user devstack@n-api.service[61841]: action_args: {'server_id': '6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99', 'id': 'ad9a8e38-a4a0-464f-8ac1-32552aaa2af3'} Apr 14 11:11:32 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ad9a8e38-a4a0-464f-8ac1-32552aaa2af3. Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 is not attached to volume ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 is not attached to volume ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 Apr 14 11:11:32 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:11:32 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-f8fb046a-fc91-4aab-ba40-2d552e6a604b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Returning 404 to user: Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 is not attached to volume ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:11:32 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-f8fb046a-fc91-4aab-ba40-2d552e6a604b tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/os-volume_attachments/ad9a8e38-a4a0-464f-8ac1-32552aaa2af3" status: 404 len: 154 microversion: 2.1 time: 0.094695 Apr 14 11:11:32 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 367/1089] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 11:11:32 2023] DELETE /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/os-volume_attachments/ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:11:36 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:11:36 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:11:36 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:36 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:36 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:36 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:36 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:36 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:36 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:11:36 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" status: 204 len: 0 microversion: 2.1 time: 0.177597 Apr 14 11:11:36 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 358/1090] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:11:36 2023] DELETE /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:11:36 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-23a604d6-f91c-4f22-b433-4f009c1c3f41 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:11:36 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-23a604d6-f91c-4f22-b433-4f009c1c3f41 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:11:36 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:11:36 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:11:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23a604d6-f91c-4f22-b433-4f009c1c3f41 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23a604d6-f91c-4f22-b433-4f009c1c3f41 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23a604d6-f91c-4f22-b433-4f009c1c3f41 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23a604d6-f91c-4f22-b433-4f009c1c3f41 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23a604d6-f91c-4f22-b433-4f009c1c3f41 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:36 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-23a604d6-f91c-4f22-b433-4f009c1c3f41 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:36 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-23a604d6-f91c-4f22-b433-4f009c1c3f41 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:11:36 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-23a604d6-f91c-4f22-b433-4f009c1c3f41 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" status: 200 len: 1542 microversion: 2.1 time: 0.242919 Apr 14 11:11:36 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 366/1091] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:11:36 2023] GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => generated 1542 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:11:36 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-e3f200ef-6f63-491f-80a7-dd1926882a0c req-e1c52ee7-e8d5-4718-8b3b-1a6043fedac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99", "name": "network-vif-unplugged", "status": "completed", "tag": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:11:36 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:11:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e3f200ef-6f63-491f-80a7-dd1926882a0c req-e1c52ee7-e8d5-4718-8b3b-1a6043fedac9 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e3f200ef-6f63-491f-80a7-dd1926882a0c req-e1c52ee7-e8d5-4718-8b3b-1a6043fedac9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:36 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e3f200ef-6f63-491f-80a7-dd1926882a0c req-e1c52ee7-e8d5-4718-8b3b-1a6043fedac9 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:36 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-e3f200ef-6f63-491f-80a7-dd1926882a0c req-e1c52ee7-e8d5-4718-8b3b-1a6043fedac9 service nova] Creating event network-vif-unplugged:cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 on user Apr 14 11:11:36 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-e3f200ef-6f63-491f-80a7-dd1926882a0c req-e1c52ee7-e8d5-4718-8b3b-1a6043fedac9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102157 Apr 14 11:11:36 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 368/1092] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:11:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:11:38 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-26f1b2b7-e76c-4bd0-ad22-20d3a571ac63 req-116fa02a-ac90-43fd-ba22-aacf974af9cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99", "name": "network-vif-deleted", "tag": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:11:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-26f1b2b7-e76c-4bd0-ad22-20d3a571ac63 req-116fa02a-ac90-43fd-ba22-aacf974af9cc service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-26f1b2b7-e76c-4bd0-ad22-20d3a571ac63 req-116fa02a-ac90-43fd-ba22-aacf974af9cc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:38 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-26f1b2b7-e76c-4bd0-ad22-20d3a571ac63 req-116fa02a-ac90-43fd-ba22-aacf974af9cc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:38 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-26f1b2b7-e76c-4bd0-ad22-20d3a571ac63 req-116fa02a-ac90-43fd-ba22-aacf974af9cc service nova] Creating event network-vif-deleted:cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 on user Apr 14 11:11:38 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-26f1b2b7-e76c-4bd0-ad22-20d3a571ac63 req-116fa02a-ac90-43fd-ba22-aacf974af9cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028980 Apr 14 11:11:38 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 359/1093] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:11:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:11:38 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-013a9508-8011-40b4-a8c4-bc4c7c912c4c req-a72b2b81-d033-4ac4-9919-118521d5a193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99", "name": "network-vif-plugged", "status": "completed", "tag": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:11:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-013a9508-8011-40b4-a8c4-bc4c7c912c4c req-a72b2b81-d033-4ac4-9919-118521d5a193 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-013a9508-8011-40b4-a8c4-bc4c7c912c4c req-a72b2b81-d033-4ac4-9919-118521d5a193 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:38 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-013a9508-8011-40b4-a8c4-bc4c7c912c4c req-a72b2b81-d033-4ac4-9919-118521d5a193 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:38 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-013a9508-8011-40b4-a8c4-bc4c7c912c4c req-a72b2b81-d033-4ac4-9919-118521d5a193 service nova] Creating event network-vif-plugged:cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 on user Apr 14 11:11:38 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-013a9508-8011-40b4-a8c4-bc4c7c912c4c req-a72b2b81-d033-4ac4-9919-118521d5a193 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029142 Apr 14 11:11:38 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 367/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:11:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:11:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f86738b-0091-4be9-bd1f-729e54374584", "name": "network-vif-plugged", "status": "completed", "tag": "6d4702fa-9e35-4be4-b3b9-015af3cddba8"}, {"server_uuid": "3f86738b-0091-4be9-bd1f-729e54374584", "name": "network-vif-plugged", "status": "completed", "tag": "6d4702fa-9e35-4be4-b3b9-015af3cddba8"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:11:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:11:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:11:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:11:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] Creating event network-vif-plugged:6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance 3f86738b-0091-4be9-bd1f-729e54374584 on user Apr 14 11:11:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] Creating event network-vif-plugged:6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance 3f86738b-0091-4be9-bd1f-729e54374584 on user Apr 14 11:11:40 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047060 Apr 14 11:11:40 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 369/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:11:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:12:13 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:12:13 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:12:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-73d7342f-2f21-4ec3-b0b1-1bf10f142b31 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:12:14 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-73d7342f-2f21-4ec3-b0b1-1bf10f142b31 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:12:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-73d7342f-2f21-4ec3-b0b1-1bf10f142b31 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:12:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-73d7342f-2f21-4ec3-b0b1-1bf10f142b31 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:12:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-73d7342f-2f21-4ec3-b0b1-1bf10f142b31 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:12:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-73d7342f-2f21-4ec3-b0b1-1bf10f142b31 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:12:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-73d7342f-2f21-4ec3-b0b1-1bf10f142b31 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:12:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-73d7342f-2f21-4ec3-b0b1-1bf10f142b31 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:12:14 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-73d7342f-2f21-4ec3-b0b1-1bf10f142b31 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:12:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-73d7342f-2f21-4ec3-b0b1-1bf10f142b31 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584" status: 200 len: 1550 microversion: 2.1 time: 0.149756 Apr 14 11:12:14 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 360/1096] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:12:13 2023] GET /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:12:26 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:12:26 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=16 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:12:26 user devstack@n-api.service[61840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 11:12:26 user devstack@n-api.service[61840]: Fri Apr 14 11:12:26 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 (ip 10.0.0.210) !!! Apr 14 11:12:26 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-fc0f884d-5a6f-4284-a131-01886e464493 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:12:26 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-fc0f884d-5a6f-4284-a131-01886e464493 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:12:26 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fc0f884d-5a6f-4284-a131-01886e464493 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:12:26 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fc0f884d-5a6f-4284-a131-01886e464493 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:12:26 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fc0f884d-5a6f-4284-a131-01886e464493 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:12:26 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fc0f884d-5a6f-4284-a131-01886e464493 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:12:26 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fc0f884d-5a6f-4284-a131-01886e464493 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:12:26 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-fc0f884d-5a6f-4284-a131-01886e464493 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:12:26 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-fc0f884d-5a6f-4284-a131-01886e464493 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] HTTP exception thrown: Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 could not be found. Apr 14 11:12:26 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-fc0f884d-5a6f-4284-a131-01886e464493 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Request method failure captured: Apr 14 11:12:26 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 HTTP/1.1 Apr 14 11:12:26 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:12:26 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:12:26 user devstack@n-api.service[61840]: Connection: close Apr 14 11:12:26 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:12:26 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:12:26 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:12:26 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:12:26 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:12:26 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTJW_nWg2J6o5vRSemm_jlYLT0-S7Yb4P258bLmZ_oKhu6WwoM645orauyJVaZxPKqfOe3071SM1yQhGISaiJoewlLZV_YCsGerTXcSPWKP8ETj9kSKFH3ym18ac0vy24ipdNhiqubWRNnQNGdXbdJml0bR5LRKX7PzbHlt-bdy21fA Apr 14 11:12:26 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:12:26 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:12:26 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:12:26 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:12:26 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:12:26 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:12:26 user devstack@n-api.service[61840]: X-Project-Id: 5809862340a84c83a772c65c77513608 Apr 14 11:12:26 user devstack@n-api.service[61840]: X-Project-Name: tempest-TestMinimumBasicScenario-2127394977 Apr 14 11:12:26 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:12:26 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:12:26 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5809862340a84c83a772c65c77513608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5809862340a84c83a772c65c77513608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5809862340a84c83a772c65c77513608"}]}] Apr 14 11:12:26 user devstack@n-api.service[61840]: X-Tenant: tempest-TestMinimumBasicScenario-2127394977 Apr 14 11:12:26 user devstack@n-api.service[61840]: X-Tenant-Id: 5809862340a84c83a772c65c77513608 Apr 14 11:12:26 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2127394977 Apr 14 11:12:26 user devstack@n-api.service[61840]: X-User: tempest-TestMinimumBasicScenario-2127394977-project-member Apr 14 11:12:26 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:12:26 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:12:26 user devstack@n-api.service[61840]: X-User-Id: 831215baa8fd4fe7ba65193bbbdad1b4 Apr 14 11:12:26 user devstack@n-api.service[61840]: X-User-Name: tempest-TestMinimumBasicScenario-2127394977-project-member Apr 14 11:12:26 user devstack@n-api.service[61840]: method: > Apr 14 11:12:26 user devstack@n-api.service[61840]: exception: Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 could not be found. Apr 14 11:12:26 user devstack@n-api.service[61840]: action_args: {'id': '6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99'} Apr 14 11:12:26 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 could not be found. Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 could not be found. Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 could not be found. Apr 14 11:12:26 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:12:26 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-fc0f884d-5a6f-4284-a131-01886e464493 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Returning 404 to user: Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:12:26 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-fc0f884d-5a6f-4284-a131-01886e464493 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" status: 404 len: 111 microversion: 2.1 time: 0.038190 Apr 14 11:12:26 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 368/1097] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:12:26 2023] GET /compute/v2.1/servers/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:12:26 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-f1c6ed2d-5f95-4347-b466-ce6ebc447bc0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Calling method '.version_select at 0x7fcd1cf5ac20>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:12:26 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=12 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:12:26 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=10 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:12:26 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-f1c6ed2d-5f95-4347-b466-ce6ebc447bc0 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1135167667" status: 202 len: 0 microversion: 2.1 time: 0.033436 Apr 14 11:12:26 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 370/1098] 10.0.0.210 () {62 vars in 1349 bytes} [Fri Apr 14 11:12:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1135167667 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 11:13:14 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:13:14 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:13:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-4abfd0b7-f654-48df-a8b1-e04ed4c5de62 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:13:14 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-4abfd0b7-f654-48df-a8b1-e04ed4c5de62 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:13:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4abfd0b7-f654-48df-a8b1-e04ed4c5de62 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:13:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4abfd0b7-f654-48df-a8b1-e04ed4c5de62 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:13:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4abfd0b7-f654-48df-a8b1-e04ed4c5de62 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:13:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4abfd0b7-f654-48df-a8b1-e04ed4c5de62 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:13:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4abfd0b7-f654-48df-a8b1-e04ed4c5de62 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:13:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-4abfd0b7-f654-48df-a8b1-e04ed4c5de62 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:13:14 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-4abfd0b7-f654-48df-a8b1-e04ed4c5de62 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:13:14 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-4abfd0b7-f654-48df-a8b1-e04ed4c5de62 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584" status: 200 len: 1550 microversion: 2.1 time: 0.190831 Apr 14 11:13:14 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 361/1099] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:13:14 2023] GET /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584 => generated 1550 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:13:14 user devstack@n-api.service[61840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3dfd377b-b582-44f5-b9e7-eb408a9b89c8] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 11:13:14 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:13:14 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:13:14 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:13:14 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:13:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:13:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:13:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:13:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:13:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:13:14 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:13:14 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Going to try to terminate instance {{(pid=61840) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:13:14 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584" status: 204 len: 0 microversion: 2.1 time: 0.126471 Apr 14 11:13:14 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 369/1100] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:13:14 2023] DELETE /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:13:14 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-d012d6fc-41ff-4e57-bba9-dc340a49b643 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:13:14 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-d012d6fc-41ff-4e57-bba9-dc340a49b643 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:13:14 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:13:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d012d6fc-41ff-4e57-bba9-dc340a49b643 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:13:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d012d6fc-41ff-4e57-bba9-dc340a49b643 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:13:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d012d6fc-41ff-4e57-bba9-dc340a49b643 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:13:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d012d6fc-41ff-4e57-bba9-dc340a49b643 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:13:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d012d6fc-41ff-4e57-bba9-dc340a49b643 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:13:14 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-d012d6fc-41ff-4e57-bba9-dc340a49b643 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:13:14 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-d012d6fc-41ff-4e57-bba9-dc340a49b643 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:13:14 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-d012d6fc-41ff-4e57-bba9-dc340a49b643 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584" status: 200 len: 1556 microversion: 2.1 time: 0.199104 Apr 14 11:13:14 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 371/1101] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:13:14 2023] GET /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584 => generated 1556 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:13:14 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-b951f1a0-79f3-45b2-953a-18c27abba57d req-ab84cb85-48f3-47a7-8fd5-db8ea49a77fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f86738b-0091-4be9-bd1f-729e54374584", "name": "network-vif-unplugged", "status": "completed", "tag": "6d4702fa-9e35-4be4-b3b9-015af3cddba8"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:13:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-b951f1a0-79f3-45b2-953a-18c27abba57d req-ab84cb85-48f3-47a7-8fd5-db8ea49a77fa service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:13:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-b951f1a0-79f3-45b2-953a-18c27abba57d req-ab84cb85-48f3-47a7-8fd5-db8ea49a77fa service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:13:14 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-b951f1a0-79f3-45b2-953a-18c27abba57d req-ab84cb85-48f3-47a7-8fd5-db8ea49a77fa service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:13:15 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-b951f1a0-79f3-45b2-953a-18c27abba57d req-ab84cb85-48f3-47a7-8fd5-db8ea49a77fa service nova] Creating event network-vif-unplugged:6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance 3f86738b-0091-4be9-bd1f-729e54374584 on user Apr 14 11:13:15 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-b951f1a0-79f3-45b2-953a-18c27abba57d req-ab84cb85-48f3-47a7-8fd5-db8ea49a77fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043463 Apr 14 11:13:15 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 362/1102] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:13:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:13:17 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f86738b-0091-4be9-bd1f-729e54374584", "name": "network-vif-plugged", "status": "completed", "tag": "6d4702fa-9e35-4be4-b3b9-015af3cddba8"}, {"server_uuid": "3f86738b-0091-4be9-bd1f-729e54374584", "name": "network-vif-plugged", "status": "completed", "tag": "6d4702fa-9e35-4be4-b3b9-015af3cddba8"}, {"server_uuid": "3f86738b-0091-4be9-bd1f-729e54374584", "name": "network-vif-plugged", "status": "completed", "tag": "6d4702fa-9e35-4be4-b3b9-015af3cddba8"}, {"server_uuid": "3f86738b-0091-4be9-bd1f-729e54374584", "name": "network-vif-plugged", "status": "completed", "tag": "6d4702fa-9e35-4be4-b3b9-015af3cddba8"}, {"server_uuid": "3f86738b-0091-4be9-bd1f-729e54374584", "name": "network-vif-deleted", "tag": "6d4702fa-9e35-4be4-b3b9-015af3cddba8"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:13:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:13:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:13:17 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:13:17 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Creating event network-vif-plugged:6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance 3f86738b-0091-4be9-bd1f-729e54374584 on user Apr 14 11:13:17 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Creating event network-vif-plugged:6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance 3f86738b-0091-4be9-bd1f-729e54374584 on user Apr 14 11:13:17 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Creating event network-vif-plugged:6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance 3f86738b-0091-4be9-bd1f-729e54374584 on user Apr 14 11:13:17 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Creating event network-vif-plugged:6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance 3f86738b-0091-4be9-bd1f-729e54374584 on user Apr 14 11:13:17 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Creating event network-vif-deleted:6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance 3f86738b-0091-4be9-bd1f-729e54374584 on user Apr 14 11:13:17 user devstack@n-api.service[61840]: INFO oslo.messaging._drivers.impl_rabbit [-] [3dfd377b-b582-44f5-b9e7-eb408a9b89c8] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 49526. Apr 14 11:13:17 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.040277 Apr 14 11:13:17 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 370/1103] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:13:17 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:14:04 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a7fb22e2-78eb-4575-84bc-87c9435d2392 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:14:04 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-a7fb22e2-78eb-4575-84bc-87c9435d2392 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:14:04 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:14:04 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:14:04 user devstack@n-api.service[61841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 11:14:04 user devstack@n-api.service[61841]: Fri Apr 14 11:14:04 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584 (ip 10.0.0.210) !!! Apr 14 11:14:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a7fb22e2-78eb-4575-84bc-87c9435d2392 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a7fb22e2-78eb-4575-84bc-87c9435d2392 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a7fb22e2-78eb-4575-84bc-87c9435d2392 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a7fb22e2-78eb-4575-84bc-87c9435d2392 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a7fb22e2-78eb-4575-84bc-87c9435d2392 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:04 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-a7fb22e2-78eb-4575-84bc-87c9435d2392 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:04 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-a7fb22e2-78eb-4575-84bc-87c9435d2392 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HTTP exception thrown: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. Apr 14 11:14:04 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a7fb22e2-78eb-4575-84bc-87c9435d2392 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Request method failure captured: Apr 14 11:14:04 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584 HTTP/1.1 Apr 14 11:14:04 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:14:04 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:14:04 user devstack@n-api.service[61841]: Connection: close Apr 14 11:14:04 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:14:04 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:14:04 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:14:04 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:14:04 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:14:04 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOTOscq830xumO0pE4afr8hOrEKJzznUYbYP-3SI3ny-DA6kv_rRe3G7iAHsQdncX43dMQiRCf9NWDRZowvTbgHtZlJuzDm2z8bxhcIzBRIAVlefTNB4nKwb-zSZ6OMRbbxZzKV1NmP0nkTSlvsXvb4bIOP4rVsUvjkb-NM520Xm7GX4 Apr 14 11:14:04 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:14:04 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:14:04 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:14:04 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:14:04 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:14:04 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:14:04 user devstack@n-api.service[61841]: X-Project-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:14:04 user devstack@n-api.service[61841]: X-Project-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:04 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:14:04 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:14:04 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}] Apr 14 11:14:04 user devstack@n-api.service[61841]: X-Tenant: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:04 user devstack@n-api.service[61841]: X-Tenant-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:14:04 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:04 user devstack@n-api.service[61841]: X-User: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:14:04 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:14:04 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:14:04 user devstack@n-api.service[61841]: X-User-Id: c7644d02bc784e4fb74ebaaceb3affe1 Apr 14 11:14:04 user devstack@n-api.service[61841]: X-User-Name: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:14:04 user devstack@n-api.service[61841]: method: > Apr 14 11:14:04 user devstack@n-api.service[61841]: exception: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. Apr 14 11:14:04 user devstack@n-api.service[61841]: action_args: {'id': '3f86738b-0091-4be9-bd1f-729e54374584'} Apr 14 11:14:04 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. Apr 14 11:14:04 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:14:04 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-a7fb22e2-78eb-4575-84bc-87c9435d2392 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Returning 404 to user: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:14:04 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-a7fb22e2-78eb-4575-84bc-87c9435d2392 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584" status: 404 len: 111 microversion: 2.1 time: 0.045236 Apr 14 11:14:04 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 372/1104] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:14:04 2023] GET /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:14:08 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:14:08 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=8 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:14:08 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:14:08 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:14:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:08 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:08 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:14:08 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91" status: 204 len: 0 microversion: 2.1 time: 0.171315 Apr 14 11:14:08 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 363/1105] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:14:08 2023] DELETE /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:14:08 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:14:08 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:14:08 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-2214a49d-b1ba-4a6a-84c2-a4db7c54b27c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:14:08 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-2214a49d-b1ba-4a6a-84c2-a4db7c54b27c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:14:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2214a49d-b1ba-4a6a-84c2-a4db7c54b27c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2214a49d-b1ba-4a6a-84c2-a4db7c54b27c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2214a49d-b1ba-4a6a-84c2-a4db7c54b27c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2214a49d-b1ba-4a6a-84c2-a4db7c54b27c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2214a49d-b1ba-4a6a-84c2-a4db7c54b27c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:08 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-2214a49d-b1ba-4a6a-84c2-a4db7c54b27c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:09 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-2214a49d-b1ba-4a6a-84c2-a4db7c54b27c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:14:09 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-2214a49d-b1ba-4a6a-84c2-a4db7c54b27c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91" status: 200 len: 1398 microversion: 2.1 time: 0.431206 Apr 14 11:14:09 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 371/1106] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:14:08 2023] GET /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91 => generated 1398 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:14:09 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-fbe8b563-9cb1-4e40-bc6e-4ea3c013ac1e req-a64601e2-8b08-4122-8b98-3d895032b3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "434ec83b-ca3c-446e-a63b-f130ceaf8e91", "name": "network-vif-unplugged", "status": "completed", "tag": "dd3954c8-cff9-4d50-a4bb-63365524ac72"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:14:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-fbe8b563-9cb1-4e40-bc6e-4ea3c013ac1e req-a64601e2-8b08-4122-8b98-3d895032b3f1 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-fbe8b563-9cb1-4e40-bc6e-4ea3c013ac1e req-a64601e2-8b08-4122-8b98-3d895032b3f1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:09 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-fbe8b563-9cb1-4e40-bc6e-4ea3c013ac1e req-a64601e2-8b08-4122-8b98-3d895032b3f1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:09 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-fbe8b563-9cb1-4e40-bc6e-4ea3c013ac1e req-a64601e2-8b08-4122-8b98-3d895032b3f1 service nova] Creating event network-vif-unplugged:dd3954c8-cff9-4d50-a4bb-63365524ac72 for instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 on user Apr 14 11:14:09 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-fbe8b563-9cb1-4e40-bc6e-4ea3c013ac1e req-a64601e2-8b08-4122-8b98-3d895032b3f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137094 Apr 14 11:14:09 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 373/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:14:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:14:11 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-cdfb4ab9-e23d-48ce-8e8a-52133c15f121 req-b9f924e4-5d67-483e-86fb-c284a06f470b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "434ec83b-ca3c-446e-a63b-f130ceaf8e91", "name": "network-vif-plugged", "status": "completed", "tag": "dd3954c8-cff9-4d50-a4bb-63365524ac72"}, {"server_uuid": "434ec83b-ca3c-446e-a63b-f130ceaf8e91", "name": "network-vif-deleted", "tag": "dd3954c8-cff9-4d50-a4bb-63365524ac72"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:14:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cdfb4ab9-e23d-48ce-8e8a-52133c15f121 req-b9f924e4-5d67-483e-86fb-c284a06f470b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cdfb4ab9-e23d-48ce-8e8a-52133c15f121 req-b9f924e4-5d67-483e-86fb-c284a06f470b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:11 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-cdfb4ab9-e23d-48ce-8e8a-52133c15f121 req-b9f924e4-5d67-483e-86fb-c284a06f470b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:11 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-cdfb4ab9-e23d-48ce-8e8a-52133c15f121 req-b9f924e4-5d67-483e-86fb-c284a06f470b service nova] Creating event network-vif-plugged:dd3954c8-cff9-4d50-a4bb-63365524ac72 for instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 on user Apr 14 11:14:11 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-cdfb4ab9-e23d-48ce-8e8a-52133c15f121 req-b9f924e4-5d67-483e-86fb-c284a06f470b service nova] Creating event network-vif-deleted:dd3954c8-cff9-4d50-a4bb-63365524ac72 for instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 on user Apr 14 11:14:11 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-cdfb4ab9-e23d-48ce-8e8a-52133c15f121 req-b9f924e4-5d67-483e-86fb-c284a06f470b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045579 Apr 14 11:14:11 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 364/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:14:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ae7da844-aef3-4868-a7a3-7c22180a868a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-ae7da844-aef3-4868-a7a3-7c22180a868a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae7da844-aef3-4868-a7a3-7c22180a868a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae7da844-aef3-4868-a7a3-7c22180a868a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae7da844-aef3-4868-a7a3-7c22180a868a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae7da844-aef3-4868-a7a3-7c22180a868a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae7da844-aef3-4868-a7a3-7c22180a868a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-ae7da844-aef3-4868-a7a3-7c22180a868a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:59 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-ae7da844-aef3-4868-a7a3-7c22180a868a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HTTP exception thrown: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ae7da844-aef3-4868-a7a3-7c22180a868a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Request method failure captured: Apr 14 11:14:59 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91 HTTP/1.1 Apr 14 11:14:59 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:14:59 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:14:59 user devstack@n-api.service[61840]: Connection: close Apr 14 11:14:59 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:14:59 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:14:59 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:14:59 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:14:59 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTOscq830xumO0pE4afr8hOrEKJzznUYbYP-3SI3ny-DA6kv_rRe3G7iAHsQdncX43dMQiRCf9NWDRZowvTbgHtZlJuzDm2z8bxhcIzBRIAVlefTNB4nKwb-zSZ6OMRbbxZzKV1NmP0nkTSlvsXvb4bIOP4rVsUvjkb-NM520Xm7GX4 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Project-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Project-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}] Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Tenant: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Tenant-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-User: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:14:59 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:14:59 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:14:59 user devstack@n-api.service[61840]: X-User-Id: c7644d02bc784e4fb74ebaaceb3affe1 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-User-Name: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:14:59 user devstack@n-api.service[61840]: method: > Apr 14 11:14:59 user devstack@n-api.service[61840]: exception: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61840]: action_args: {'id': '434ec83b-ca3c-446e-a63b-f130ceaf8e91'} Apr 14 11:14:59 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ae7da844-aef3-4868-a7a3-7c22180a868a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Returning 404 to user: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:14:59 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-ae7da844-aef3-4868-a7a3-7c22180a868a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91" status: 404 len: 111 microversion: 2.1 time: 0.032503 Apr 14 11:14:59 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 372/1109] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:14:59 2023] GET /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [39e70ef5-6646-496c-bab9-1bdc9fdde40b] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:14:59 user devstack@n-api.service[61841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 11:14:59 user devstack@n-api.service[61841]: Fri Apr 14 11:14:59 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584 (ip 10.0.0.210) !!! Apr 14 11:14:59 user devstack@n-api.service[61841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 11:14:59 user devstack@n-api.service[61841]: Fri Apr 14 11:14:59 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584 (ip 10.0.0.210) !!! Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-09d1a5bc-b625-446e-8fe3-dac36f9393fe tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-09d1a5bc-b625-446e-8fe3-dac36f9393fe tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-09d1a5bc-b625-446e-8fe3-dac36f9393fe tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-09d1a5bc-b625-446e-8fe3-dac36f9393fe tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-09d1a5bc-b625-446e-8fe3-dac36f9393fe tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-09d1a5bc-b625-446e-8fe3-dac36f9393fe tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-09d1a5bc-b625-446e-8fe3-dac36f9393fe tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-09d1a5bc-b625-446e-8fe3-dac36f9393fe tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:59 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-09d1a5bc-b625-446e-8fe3-dac36f9393fe tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HTTP exception thrown: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-09d1a5bc-b625-446e-8fe3-dac36f9393fe tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Request method failure captured: Apr 14 11:14:59 user devstack@n-api.service[61841]: request: DELETE /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584 HTTP/1.1 Apr 14 11:14:59 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:14:59 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:14:59 user devstack@n-api.service[61841]: Connection: close Apr 14 11:14:59 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:14:59 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:14:59 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:14:59 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:14:59 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOTOscq830xumO0pE4afr8hOrEKJzznUYbYP-3SI3ny-DA6kv_rRe3G7iAHsQdncX43dMQiRCf9NWDRZowvTbgHtZlJuzDm2z8bxhcIzBRIAVlefTNB4nKwb-zSZ6OMRbbxZzKV1NmP0nkTSlvsXvb4bIOP4rVsUvjkb-NM520Xm7GX4 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Project-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Project-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}] Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Tenant: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Tenant-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-User: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:14:59 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:14:59 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:14:59 user devstack@n-api.service[61841]: X-User-Id: c7644d02bc784e4fb74ebaaceb3affe1 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-User-Name: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:14:59 user devstack@n-api.service[61841]: method: > Apr 14 11:14:59 user devstack@n-api.service[61841]: exception: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61841]: action_args: {'id': '3f86738b-0091-4be9-bd1f-729e54374584'} Apr 14 11:14:59 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-09d1a5bc-b625-446e-8fe3-dac36f9393fe tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Returning 404 to user: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:14:59 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-09d1a5bc-b625-446e-8fe3-dac36f9393fe tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584" status: 404 len: 111 microversion: 2.1 time: 0.044798 Apr 14 11:14:59 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 374/1110] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:14:59 2023] DELETE /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:14:59 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-57de7d17-ea68-4305-a238-1a27b5299b2a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:14:59 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-57de7d17-ea68-4305-a238-1a27b5299b2a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:14:59 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:14:59 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:14:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-57de7d17-ea68-4305-a238-1a27b5299b2a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-57de7d17-ea68-4305-a238-1a27b5299b2a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-57de7d17-ea68-4305-a238-1a27b5299b2a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-57de7d17-ea68-4305-a238-1a27b5299b2a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-57de7d17-ea68-4305-a238-1a27b5299b2a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-57de7d17-ea68-4305-a238-1a27b5299b2a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-57de7d17-ea68-4305-a238-1a27b5299b2a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HTTP exception thrown: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-57de7d17-ea68-4305-a238-1a27b5299b2a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Request method failure captured: Apr 14 11:14:59 user devstack@n-api.service[61839]: request: GET /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584 HTTP/1.1 Apr 14 11:14:59 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:14:59 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:14:59 user devstack@n-api.service[61839]: Connection: close Apr 14 11:14:59 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:14:59 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:14:59 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:14:59 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:14:59 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:14:59 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTOscq830xumO0pE4afr8hOrEKJzznUYbYP-3SI3ny-DA6kv_rRe3G7iAHsQdncX43dMQiRCf9NWDRZowvTbgHtZlJuzDm2z8bxhcIzBRIAVlefTNB4nKwb-zSZ6OMRbbxZzKV1NmP0nkTSlvsXvb4bIOP4rVsUvjkb-NM520Xm7GX4 Apr 14 11:14:59 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:14:59 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:14:59 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:14:59 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:14:59 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:14:59 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:14:59 user devstack@n-api.service[61839]: X-Project-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:14:59 user devstack@n-api.service[61839]: X-Project-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:59 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:14:59 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:14:59 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}] Apr 14 11:14:59 user devstack@n-api.service[61839]: X-Tenant: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:59 user devstack@n-api.service[61839]: X-Tenant-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:14:59 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:59 user devstack@n-api.service[61839]: X-User: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:14:59 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:14:59 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:14:59 user devstack@n-api.service[61839]: X-User-Id: c7644d02bc784e4fb74ebaaceb3affe1 Apr 14 11:14:59 user devstack@n-api.service[61839]: X-User-Name: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:14:59 user devstack@n-api.service[61839]: method: > Apr 14 11:14:59 user devstack@n-api.service[61839]: exception: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61839]: action_args: {'id': '3f86738b-0091-4be9-bd1f-729e54374584'} Apr 14 11:14:59 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-57de7d17-ea68-4305-a238-1a27b5299b2a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Returning 404 to user: Instance 3f86738b-0091-4be9-bd1f-729e54374584 could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:14:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-57de7d17-ea68-4305-a238-1a27b5299b2a tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584" status: 404 len: 111 microversion: 2.1 time: 0.045930 Apr 14 11:14:59 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 365/1111] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:14:59 2023] GET /compute/v2.1/servers/3f86738b-0091-4be9-bd1f-729e54374584 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-caab4d5f-59e6-4cfd-9085-350d3a5c904d tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-caab4d5f-59e6-4cfd-9085-350d3a5c904d tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-caab4d5f-59e6-4cfd-9085-350d3a5c904d tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-caab4d5f-59e6-4cfd-9085-350d3a5c904d tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-caab4d5f-59e6-4cfd-9085-350d3a5c904d tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-caab4d5f-59e6-4cfd-9085-350d3a5c904d tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-caab4d5f-59e6-4cfd-9085-350d3a5c904d tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-caab4d5f-59e6-4cfd-9085-350d3a5c904d tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:59 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-caab4d5f-59e6-4cfd-9085-350d3a5c904d tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HTTP exception thrown: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-caab4d5f-59e6-4cfd-9085-350d3a5c904d tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Request method failure captured: Apr 14 11:14:59 user devstack@n-api.service[61840]: request: DELETE /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91 HTTP/1.1 Apr 14 11:14:59 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:14:59 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:14:59 user devstack@n-api.service[61840]: Connection: close Apr 14 11:14:59 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:14:59 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:14:59 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:14:59 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:14:59 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTOscq830xumO0pE4afr8hOrEKJzznUYbYP-3SI3ny-DA6kv_rRe3G7iAHsQdncX43dMQiRCf9NWDRZowvTbgHtZlJuzDm2z8bxhcIzBRIAVlefTNB4nKwb-zSZ6OMRbbxZzKV1NmP0nkTSlvsXvb4bIOP4rVsUvjkb-NM520Xm7GX4 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Project-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Project-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}] Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Tenant: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Tenant-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-User: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:14:59 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:14:59 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:14:59 user devstack@n-api.service[61840]: X-User-Id: c7644d02bc784e4fb74ebaaceb3affe1 Apr 14 11:14:59 user devstack@n-api.service[61840]: X-User-Name: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:14:59 user devstack@n-api.service[61840]: method: > Apr 14 11:14:59 user devstack@n-api.service[61840]: exception: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61840]: action_args: {'id': '434ec83b-ca3c-446e-a63b-f130ceaf8e91'} Apr 14 11:14:59 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-caab4d5f-59e6-4cfd-9085-350d3a5c904d tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Returning 404 to user: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:14:59 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-caab4d5f-59e6-4cfd-9085-350d3a5c904d tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91" status: 404 len: 111 microversion: 2.1 time: 0.028596 Apr 14 11:14:59 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 373/1112] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:14:59 2023] DELETE /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-aed66ad6-4f5e-400f-9b2d-3b82461ddcad tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-aed66ad6-4f5e-400f-9b2d-3b82461ddcad tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aed66ad6-4f5e-400f-9b2d-3b82461ddcad tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aed66ad6-4f5e-400f-9b2d-3b82461ddcad tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aed66ad6-4f5e-400f-9b2d-3b82461ddcad tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aed66ad6-4f5e-400f-9b2d-3b82461ddcad tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aed66ad6-4f5e-400f-9b2d-3b82461ddcad tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-aed66ad6-4f5e-400f-9b2d-3b82461ddcad tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:14:59 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-aed66ad6-4f5e-400f-9b2d-3b82461ddcad tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HTTP exception thrown: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-aed66ad6-4f5e-400f-9b2d-3b82461ddcad tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Request method failure captured: Apr 14 11:14:59 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91 HTTP/1.1 Apr 14 11:14:59 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:14:59 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:14:59 user devstack@n-api.service[61841]: Connection: close Apr 14 11:14:59 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:14:59 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:14:59 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:14:59 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:14:59 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOTOscq830xumO0pE4afr8hOrEKJzznUYbYP-3SI3ny-DA6kv_rRe3G7iAHsQdncX43dMQiRCf9NWDRZowvTbgHtZlJuzDm2z8bxhcIzBRIAVlefTNB4nKwb-zSZ6OMRbbxZzKV1NmP0nkTSlvsXvb4bIOP4rVsUvjkb-NM520Xm7GX4 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Project-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Project-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}] Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Tenant: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Tenant-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-User: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:14:59 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:14:59 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:14:59 user devstack@n-api.service[61841]: X-User-Id: c7644d02bc784e4fb74ebaaceb3affe1 Apr 14 11:14:59 user devstack@n-api.service[61841]: X-User-Name: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:14:59 user devstack@n-api.service[61841]: method: > Apr 14 11:14:59 user devstack@n-api.service[61841]: exception: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61841]: action_args: {'id': '434ec83b-ca3c-446e-a63b-f130ceaf8e91'} Apr 14 11:14:59 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. Apr 14 11:14:59 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:14:59 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-aed66ad6-4f5e-400f-9b2d-3b82461ddcad tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Returning 404 to user: Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:14:59 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-aed66ad6-4f5e-400f-9b2d-3b82461ddcad tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91" status: 404 len: 111 microversion: 2.1 time: 0.028130 Apr 14 11:14:59 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 375/1113] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:14:59 2023] GET /compute/v2.1/servers/434ec83b-ca3c-446e-a63b-f130ceaf8e91 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:14:59 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-88682489-3dc4-46c2-88ed-3eb3aa5d318b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Action: 'create', calling method: .version_select at 0x7fcd1d23fe20>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-994193383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBafeRTei9AGsMhDE/c+DnIhp7w6x54r1wV/PnusBRf64WHX2LZne4yrEE3WXFq7Jmo1e2MZSS8o0Igq9Iy9JMCogkqExXP7DS8p2/L3yNdO3UPcBKE6h/z0FEi5FWn3lg=="}} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:14:59 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-88682489-3dc4-46c2-88ed-3eb3aa5d318b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting quotas for project 2e7089cb52574f1daf7f578222bb7a67. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:14:59 user devstack@n-api.service[61839]: DEBUG nova.quota [None req-88682489-3dc4-46c2-88ed-3eb3aa5d318b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting quotas for user c7644d02bc784e4fb74ebaaceb3affe1 and project 2e7089cb52574f1daf7f578222bb7a67. Resources: {'key_pairs'} {{(pid=61839) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:14:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-88682489-3dc4-46c2-88ed-3eb3aa5d318b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.055580 Apr 14 11:14:59 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 366/1114] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 11:14:59 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:15:04 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1896883992", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-994193383", "security_groups": [{"name": "tempest-secgroup-smoke-1185924440"}], "block_device_mapping_v2": [{"uuid": "3dfb7018-b582-43c0-b9b5-f58822b9b5c6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32"}]}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:15:04 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] validate_networks() for [('6d6b6b35-b5ef-4d7c-abce-cad21cc99e32', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:15:05 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:15:05 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:15:05 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:15:05 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:15:05 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:15:05 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:15:05 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:15:05 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:15:05 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:15:05 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:15:05 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:15:05 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting quotas for project 2e7089cb52574f1daf7f578222bb7a67. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:15:05 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting quotas for user c7644d02bc784e4fb74ebaaceb3affe1 and project 2e7089cb52574f1daf7f578222bb7a67. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:15:05 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:15:05 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3dfb7018-b582-43c0-b9b5-f58822b9b5c6',volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:15:05 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.812411 Apr 14 11:15:05 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 374/1115] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:15:04 2023] POST /compute/v2.1/servers => generated 404 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:15:05 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-bd38fb26-d935-4da1-b693-c1ab466deed4 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:15:05 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-bd38fb26-d935-4da1-b693-c1ab466deed4 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:15:05 user devstack@n-api.service[61841]: INFO oslo.messaging._drivers.impl_rabbit [-] [39e70ef5-6646-496c-bab9-1bdc9fdde40b] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 58212. Apr 14 11:15:05 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-bd38fb26-d935-4da1-b693-c1ab466deed4 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:15:05 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-bd38fb26-d935-4da1-b693-c1ab466deed4 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f" status: 200 len: 1089 microversion: 2.1 time: 0.126665 Apr 14 11:15:05 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 376/1116] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:15:05 2023] GET /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f => generated 1089 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:15:07 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-3129d68d-e705-4efb-b0a3-ff651906a2d8 req-921ff330-3fa7-4dc8-becd-3ff49ce9b9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c4d3f81-5c17-4116-819b-84cefb35336f", "tag": "f93da95e-422e-44f2-97c7-d99b7fd6df87"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:15:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-3129d68d-e705-4efb-b0a3-ff651906a2d8 req-921ff330-3fa7-4dc8-becd-3ff49ce9b9b5 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:15:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-3129d68d-e705-4efb-b0a3-ff651906a2d8 req-921ff330-3fa7-4dc8-becd-3ff49ce9b9b5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:15:07 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-3129d68d-e705-4efb-b0a3-ff651906a2d8 req-921ff330-3fa7-4dc8-becd-3ff49ce9b9b5 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:15:07 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-3129d68d-e705-4efb-b0a3-ff651906a2d8 req-921ff330-3fa7-4dc8-becd-3ff49ce9b9b5 service nova] Creating event network-changed:f93da95e-422e-44f2-97c7-d99b7fd6df87 for instance 3c4d3f81-5c17-4116-819b-84cefb35336f on user Apr 14 11:15:07 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-3129d68d-e705-4efb-b0a3-ff651906a2d8 req-921ff330-3fa7-4dc8-becd-3ff49ce9b9b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028221 Apr 14 11:15:07 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 367/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:15:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:15:16 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:15:16 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:15:16 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:15:16 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:15:16 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-5c73a21a-9aa8-4409-a089-e40905fe7866 req-a56a1695-7f3c-4659-95e7-79b92672eccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4d3f81-5c17-4116-819b-84cefb35336f", "name": "network-vif-plugged", "status": "completed", "tag": "f93da95e-422e-44f2-97c7-d99b7fd6df87"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:15:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-5c73a21a-9aa8-4409-a089-e40905fe7866 req-a56a1695-7f3c-4659-95e7-79b92672eccc service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:15:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-5c73a21a-9aa8-4409-a089-e40905fe7866 req-a56a1695-7f3c-4659-95e7-79b92672eccc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:15:16 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-5c73a21a-9aa8-4409-a089-e40905fe7866 req-a56a1695-7f3c-4659-95e7-79b92672eccc service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:15:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-5c73a21a-9aa8-4409-a089-e40905fe7866 req-a56a1695-7f3c-4659-95e7-79b92672eccc service nova] Creating event network-vif-plugged:f93da95e-422e-44f2-97c7-d99b7fd6df87 for instance 3c4d3f81-5c17-4116-819b-84cefb35336f on user Apr 14 11:15:16 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-5c73a21a-9aa8-4409-a089-e40905fe7866 req-a56a1695-7f3c-4659-95e7-79b92672eccc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036302 Apr 14 11:15:16 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 375/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:15:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:15:18 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-91d0b2c0-8722-41a4-834f-ea74a937cadc req-14f49e1a-d76a-469a-84eb-ef54f71c9159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4d3f81-5c17-4116-819b-84cefb35336f", "name": "network-vif-plugged", "status": "completed", "tag": "f93da95e-422e-44f2-97c7-d99b7fd6df87"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:15:18 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:15:18 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=8 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:15:18 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:15:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-91d0b2c0-8722-41a4-834f-ea74a937cadc req-14f49e1a-d76a-469a-84eb-ef54f71c9159 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:15:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-91d0b2c0-8722-41a4-834f-ea74a937cadc req-14f49e1a-d76a-469a-84eb-ef54f71c9159 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:15:18 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-91d0b2c0-8722-41a4-834f-ea74a937cadc req-14f49e1a-d76a-469a-84eb-ef54f71c9159 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:15:18 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-91d0b2c0-8722-41a4-834f-ea74a937cadc req-14f49e1a-d76a-469a-84eb-ef54f71c9159 service nova] Creating event network-vif-plugged:f93da95e-422e-44f2-97c7-d99b7fd6df87 for instance 3c4d3f81-5c17-4116-819b-84cefb35336f on user Apr 14 11:15:18 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-91d0b2c0-8722-41a4-834f-ea74a937cadc req-14f49e1a-d76a-469a-84eb-ef54f71c9159 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037452 Apr 14 11:15:18 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 377/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:15:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:15:55 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:15:55 user devstack@n-api.service[61839]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 11:15:55 user devstack@n-api.service[61839]: Fri Apr 14 11:15:55 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f (ip 10.0.0.210) !!! Apr 14 11:15:55 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:15:55 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:15:55 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-f76dd4ce-07f6-4eea-a3fa-a18a0748208f tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:15:55 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-f76dd4ce-07f6-4eea-a3fa-a18a0748208f tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:15:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f76dd4ce-07f6-4eea-a3fa-a18a0748208f tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:15:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f76dd4ce-07f6-4eea-a3fa-a18a0748208f tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:15:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f76dd4ce-07f6-4eea-a3fa-a18a0748208f tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:15:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f76dd4ce-07f6-4eea-a3fa-a18a0748208f tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:15:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f76dd4ce-07f6-4eea-a3fa-a18a0748208f tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:15:55 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-f76dd4ce-07f6-4eea-a3fa-a18a0748208f tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:15:55 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-f76dd4ce-07f6-4eea-a3fa-a18a0748208f tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:15:55 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-f76dd4ce-07f6-4eea-a3fa-a18a0748208f tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f" status: 200 len: 1441 microversion: 2.1 time: 0.253421 Apr 14 11:15:55 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 368/1120] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:15:55 2023] GET /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f => generated 1441 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:16:56 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:16:56 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:16:56 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-62779a2c-ce98-4b37-9b76-f1eb00d8fb73 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:16:56 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-62779a2c-ce98-4b37-9b76-f1eb00d8fb73 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:16:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-62779a2c-ce98-4b37-9b76-f1eb00d8fb73 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:16:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-62779a2c-ce98-4b37-9b76-f1eb00d8fb73 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:16:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-62779a2c-ce98-4b37-9b76-f1eb00d8fb73 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:16:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-62779a2c-ce98-4b37-9b76-f1eb00d8fb73 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:16:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-62779a2c-ce98-4b37-9b76-f1eb00d8fb73 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:16:56 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-62779a2c-ce98-4b37-9b76-f1eb00d8fb73 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:16:56 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-62779a2c-ce98-4b37-9b76-f1eb00d8fb73 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:16:56 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-62779a2c-ce98-4b37-9b76-f1eb00d8fb73 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f" status: 200 len: 1441 microversion: 2.1 time: 0.257713 Apr 14 11:16:56 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 376/1121] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:16:56 2023] GET /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f => generated 1441 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:16:57 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:16:57 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:16:57 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-e5d0b93a-ffbd-44fb-ac27-24324e22f8e1 req-59ace5e6-231c-4ebe-8d6d-bd20ee08f5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c4d3f81-5c17-4116-819b-84cefb35336f", "tag": "f93da95e-422e-44f2-97c7-d99b7fd6df87"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:16:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e5d0b93a-ffbd-44fb-ac27-24324e22f8e1 req-59ace5e6-231c-4ebe-8d6d-bd20ee08f5f1 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:16:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e5d0b93a-ffbd-44fb-ac27-24324e22f8e1 req-59ace5e6-231c-4ebe-8d6d-bd20ee08f5f1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:16:57 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e5d0b93a-ffbd-44fb-ac27-24324e22f8e1 req-59ace5e6-231c-4ebe-8d6d-bd20ee08f5f1 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:16:57 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-e5d0b93a-ffbd-44fb-ac27-24324e22f8e1 req-59ace5e6-231c-4ebe-8d6d-bd20ee08f5f1 service nova] Creating event network-changed:f93da95e-422e-44f2-97c7-d99b7fd6df87 for instance 3c4d3f81-5c17-4116-819b-84cefb35336f on user Apr 14 11:16:57 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-e5d0b93a-ffbd-44fb-ac27-24324e22f8e1 req-59ace5e6-231c-4ebe-8d6d-bd20ee08f5f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086976 Apr 14 11:16:57 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 378/1122] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:16:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:16:59 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:16:59 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:16:59 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:16:59 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:16:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:16:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:16:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:16:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:16:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:16:59 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:16:59 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:16:59 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f" status: 204 len: 0 microversion: 2.1 time: 0.120427 Apr 14 11:16:59 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 369/1123] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:16:59 2023] DELETE /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 14 11:16:59 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-79c4c027-261e-4b8f-8859-ac63d1f6a2f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:16:59 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-79c4c027-261e-4b8f-8859-ac63d1f6a2f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:16:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-79c4c027-261e-4b8f-8859-ac63d1f6a2f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:16:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-79c4c027-261e-4b8f-8859-ac63d1f6a2f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:16:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-79c4c027-261e-4b8f-8859-ac63d1f6a2f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:16:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-79c4c027-261e-4b8f-8859-ac63d1f6a2f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:16:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-79c4c027-261e-4b8f-8859-ac63d1f6a2f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:16:59 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-79c4c027-261e-4b8f-8859-ac63d1f6a2f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:16:59 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-79c4c027-261e-4b8f-8859-ac63d1f6a2f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:16:59 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-79c4c027-261e-4b8f-8859-ac63d1f6a2f1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f" status: 200 len: 1566 microversion: 2.1 time: 0.155113 Apr 14 11:16:59 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 377/1124] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:16:59 2023] GET /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:16:59 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-22e2384e-dd7e-44c1-a6c9-efb93c87fa99 req-9fad8600-2f9e-40d0-b3ac-dad1463b71b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4d3f81-5c17-4116-819b-84cefb35336f", "name": "network-vif-unplugged", "status": "completed", "tag": "f93da95e-422e-44f2-97c7-d99b7fd6df87"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:16:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-22e2384e-dd7e-44c1-a6c9-efb93c87fa99 req-9fad8600-2f9e-40d0-b3ac-dad1463b71b2 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:16:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-22e2384e-dd7e-44c1-a6c9-efb93c87fa99 req-9fad8600-2f9e-40d0-b3ac-dad1463b71b2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:16:59 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-22e2384e-dd7e-44c1-a6c9-efb93c87fa99 req-9fad8600-2f9e-40d0-b3ac-dad1463b71b2 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:16:59 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-22e2384e-dd7e-44c1-a6c9-efb93c87fa99 req-9fad8600-2f9e-40d0-b3ac-dad1463b71b2 service nova] Creating event network-vif-unplugged:f93da95e-422e-44f2-97c7-d99b7fd6df87 for instance 3c4d3f81-5c17-4116-819b-84cefb35336f on user Apr 14 11:16:59 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-22e2384e-dd7e-44c1-a6c9-efb93c87fa99 req-9fad8600-2f9e-40d0-b3ac-dad1463b71b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032799 Apr 14 11:16:59 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 379/1125] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:16:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:17:01 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-148e9b4d-d1a2-4476-a5ba-c9741fbdf8a1 req-ecc3912b-b81f-4b80-a8ba-0e207ee50e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c4d3f81-5c17-4116-819b-84cefb35336f", "name": "network-vif-plugged", "status": "completed", "tag": "f93da95e-422e-44f2-97c7-d99b7fd6df87"}, {"server_uuid": "3c4d3f81-5c17-4116-819b-84cefb35336f", "name": "network-vif-deleted", "tag": "f93da95e-422e-44f2-97c7-d99b7fd6df87"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:17:01 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-148e9b4d-d1a2-4476-a5ba-c9741fbdf8a1 req-ecc3912b-b81f-4b80-a8ba-0e207ee50e8d service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:17:01 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-148e9b4d-d1a2-4476-a5ba-c9741fbdf8a1 req-ecc3912b-b81f-4b80-a8ba-0e207ee50e8d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:17:01 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-148e9b4d-d1a2-4476-a5ba-c9741fbdf8a1 req-ecc3912b-b81f-4b80-a8ba-0e207ee50e8d service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:17:01 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-148e9b4d-d1a2-4476-a5ba-c9741fbdf8a1 req-ecc3912b-b81f-4b80-a8ba-0e207ee50e8d service nova] Creating event network-vif-plugged:f93da95e-422e-44f2-97c7-d99b7fd6df87 for instance 3c4d3f81-5c17-4116-819b-84cefb35336f on user Apr 14 11:17:01 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-148e9b4d-d1a2-4476-a5ba-c9741fbdf8a1 req-ecc3912b-b81f-4b80-a8ba-0e207ee50e8d service nova] Creating event network-vif-deleted:f93da95e-422e-44f2-97c7-d99b7fd6df87 for instance 3c4d3f81-5c17-4116-819b-84cefb35336f on user Apr 14 11:17:01 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-148e9b4d-d1a2-4476-a5ba-c9741fbdf8a1 req-ecc3912b-b81f-4b80-a8ba-0e207ee50e8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031085 Apr 14 11:17:01 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 370/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:17:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:17:49 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-0d2587ac-0799-446c-9789-4a560b515382 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:17:49 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-0d2587ac-0799-446c-9789-4a560b515382 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3dfd377b-b582-44f5-b9e7-eb408a9b89c8] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 11:17:49 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:17:49 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=12 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:17:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0d2587ac-0799-446c-9789-4a560b515382 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:17:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0d2587ac-0799-446c-9789-4a560b515382 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:17:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0d2587ac-0799-446c-9789-4a560b515382 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:17:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0d2587ac-0799-446c-9789-4a560b515382 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:17:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0d2587ac-0799-446c-9789-4a560b515382 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:17:49 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-0d2587ac-0799-446c-9789-4a560b515382 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:17:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-0d2587ac-0799-446c-9789-4a560b515382 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HTTP exception thrown: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. Apr 14 11:17:49 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-0d2587ac-0799-446c-9789-4a560b515382 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Request method failure captured: Apr 14 11:17:49 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f HTTP/1.1 Apr 14 11:17:49 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:17:49 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:17:49 user devstack@n-api.service[61840]: Connection: close Apr 14 11:17:49 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:17:49 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:17:49 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:17:49 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:17:49 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:17:49 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTOscq830xumO0pE4afr8hOrEKJzznUYbYP-3SI3ny-DA6kv_rRe3G7iAHsQdncX43dMQiRCf9NWDRZowvTbgHtZlJuzDm2z8bxhcIzBRIAVlefTNB4nKwb-zSZ6OMRbbxZzKV1NmP0nkTSlvsXvb4bIOP4rVsUvjkb-NM520Xm7GX4 Apr 14 11:17:49 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:17:49 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:17:49 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:17:49 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:17:49 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:17:49 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:17:49 user devstack@n-api.service[61840]: X-Project-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:17:49 user devstack@n-api.service[61840]: X-Project-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:17:49 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:17:49 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:17:49 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}] Apr 14 11:17:49 user devstack@n-api.service[61840]: X-Tenant: tempest-TestVolumeBootPattern-193101874 Apr 14 11:17:49 user devstack@n-api.service[61840]: X-Tenant-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:17:49 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:17:49 user devstack@n-api.service[61840]: X-User: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:17:49 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:17:49 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:17:49 user devstack@n-api.service[61840]: X-User-Id: c7644d02bc784e4fb74ebaaceb3affe1 Apr 14 11:17:49 user devstack@n-api.service[61840]: X-User-Name: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:17:49 user devstack@n-api.service[61840]: method: > Apr 14 11:17:49 user devstack@n-api.service[61840]: exception: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. Apr 14 11:17:49 user devstack@n-api.service[61840]: action_args: {'id': '3c4d3f81-5c17-4116-819b-84cefb35336f'} Apr 14 11:17:49 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. Apr 14 11:17:49 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:17:49 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-0d2587ac-0799-446c-9789-4a560b515382 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Returning 404 to user: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:17:49 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-0d2587ac-0799-446c-9789-4a560b515382 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f" status: 404 len: 111 microversion: 2.1 time: 0.034055 Apr 14 11:17:49 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 378/1127] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:17:49 2023] GET /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:17:49 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:17:49 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:17:49 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-354097238", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-994193383", "security_groups": [{"name": "tempest-secgroup-smoke-1185924440"}], "block_device_mapping_v2": [{"uuid": "3dfb7018-b582-43c0-b9b5-f58822b9b5c6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32"}]}} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:17:49 user devstack@n-api.service[61841]: DEBUG nova.network.neutron [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] validate_networks() for [('6d6b6b35-b5ef-4d7c-abce-cad21cc99e32', None, None, None, None, None)] {{(pid=61841) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:17:50 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:17:50 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image limits 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:17:50 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:17:50 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image pref 0:0:0 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:17:50 user devstack@n-api.service[61841]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61841) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:17:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:17:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:17:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:17:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:17:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:17:50 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:17:50 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting quotas for project 2e7089cb52574f1daf7f578222bb7a67. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:17:50 user devstack@n-api.service[61841]: DEBUG nova.quota [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting quotas for user c7644d02bc784e4fb74ebaaceb3affe1 and project 2e7089cb52574f1daf7f578222bb7a67. Resources: {'cores', 'instances', 'ram'} {{(pid=61841) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:17:50 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Going to run 1 instances... {{(pid=61841) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:17:50 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3dfb7018-b582-43c0-b9b5-f58822b9b5c6',volume_size=None,volume_type=None)] {{(pid=61841) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:17:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.928516 Apr 14 11:17:50 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 380/1128] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:17:49 2023] POST /compute/v2.1/servers => generated 404 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:17:50 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:17:50 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:17:50 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-50d3939e-465f-4c00-8c9c-1b560c727502 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:17:50 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-50d3939e-465f-4c00-8c9c-1b560c727502 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:17:50 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-50d3939e-465f-4c00-8c9c-1b560c727502 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:17:50 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-50d3939e-465f-4c00-8c9c-1b560c727502 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfd4b9b2-a5fe-412f-b17b-2d45367ea438" status: 200 len: 1088 microversion: 2.1 time: 0.091398 Apr 14 11:17:50 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 371/1129] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:17:50 2023] GET /compute/v2.1/servers/bfd4b9b2-a5fe-412f-b17b-2d45367ea438 => generated 1088 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:17:52 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfd4b9b2-a5fe-412f-b17b-2d45367ea438", "tag": "0c3004b4-2439-46a3-b5f9-67e77b319a70"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:17:52 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:17:52 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:17:52 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:17:52 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] Creating event network-changed:0c3004b4-2439-46a3-b5f9-67e77b319a70 for instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 on user Apr 14 11:17:52 user devstack@n-api.service[61840]: ERROR oslo.messaging._drivers.impl_rabbit [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] [ab24796a-b348-4cc5-a12e-f2590891985b] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 11:17:52 user devstack@n-api.service[61840]: INFO oslo.messaging._drivers.impl_rabbit [-] [3dfd377b-b582-44f5-b9e7-eb408a9b89c8] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 58286. Apr 14 11:17:53 user devstack@n-api.service[61840]: INFO oslo.messaging._drivers.impl_rabbit [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] [ab24796a-b348-4cc5-a12e-f2590891985b] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 43104. Apr 14 11:17:53 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.042278 Apr 14 11:17:53 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 379/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:17:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:17:58 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-917765d4-648f-4ab0-9f02-52df2d75f8ac req-92f29337-7231-475f-8eb6-8b5b63f3b510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd4b9b2-a5fe-412f-b17b-2d45367ea438", "name": "network-vif-plugged", "status": "completed", "tag": "0c3004b4-2439-46a3-b5f9-67e77b319a70"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:17:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-917765d4-648f-4ab0-9f02-52df2d75f8ac req-92f29337-7231-475f-8eb6-8b5b63f3b510 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:17:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-917765d4-648f-4ab0-9f02-52df2d75f8ac req-92f29337-7231-475f-8eb6-8b5b63f3b510 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:17:58 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-917765d4-648f-4ab0-9f02-52df2d75f8ac req-92f29337-7231-475f-8eb6-8b5b63f3b510 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:17:58 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-917765d4-648f-4ab0-9f02-52df2d75f8ac req-92f29337-7231-475f-8eb6-8b5b63f3b510 service nova] Creating event network-vif-plugged:0c3004b4-2439-46a3-b5f9-67e77b319a70 for instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 on user Apr 14 11:17:58 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-917765d4-648f-4ab0-9f02-52df2d75f8ac req-92f29337-7231-475f-8eb6-8b5b63f3b510 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088566 Apr 14 11:17:58 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 381/1131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:17:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:18:00 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-b1a58399-0140-4f16-93c0-d3e2bc8acb4f req-f91c7578-c7d9-4af0-9831-ee8a3d8b728b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd4b9b2-a5fe-412f-b17b-2d45367ea438", "name": "network-vif-plugged", "status": "completed", "tag": "0c3004b4-2439-46a3-b5f9-67e77b319a70"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:18:00 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell0:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:18:00 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-b1a58399-0140-4f16-93c0-d3e2bc8acb4f req-f91c7578-c7d9-4af0-9831-ee8a3d8b728b service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:18:00 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-b1a58399-0140-4f16-93c0-d3e2bc8acb4f req-f91c7578-c7d9-4af0-9831-ee8a3d8b728b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:18:00 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-b1a58399-0140-4f16-93c0-d3e2bc8acb4f req-f91c7578-c7d9-4af0-9831-ee8a3d8b728b service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:18:00 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-b1a58399-0140-4f16-93c0-d3e2bc8acb4f req-f91c7578-c7d9-4af0-9831-ee8a3d8b728b service nova] Creating event network-vif-plugged:0c3004b4-2439-46a3-b5f9-67e77b319a70 for instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 on user Apr 14 11:18:00 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-b1a58399-0140-4f16-93c0-d3e2bc8acb4f req-f91c7578-c7d9-4af0-9831-ee8a3d8b728b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034301 Apr 14 11:18:00 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 372/1132] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:18:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:18:40 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:18:40 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:18:40 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-5375131c-3299-47c3-9643-e320762ecdcd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:18:40 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-5375131c-3299-47c3-9643-e320762ecdcd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:18:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5375131c-3299-47c3-9643-e320762ecdcd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:18:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5375131c-3299-47c3-9643-e320762ecdcd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:18:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5375131c-3299-47c3-9643-e320762ecdcd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:18:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5375131c-3299-47c3-9643-e320762ecdcd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:18:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5375131c-3299-47c3-9643-e320762ecdcd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:18:40 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-5375131c-3299-47c3-9643-e320762ecdcd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:18:40 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-5375131c-3299-47c3-9643-e320762ecdcd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:18:40 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-5375131c-3299-47c3-9643-e320762ecdcd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfd4b9b2-a5fe-412f-b17b-2d45367ea438" status: 200 len: 1440 microversion: 2.1 time: 0.180880 Apr 14 11:18:40 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 380/1133] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:18:40 2023] GET /compute/v2.1/servers/bfd4b9b2-a5fe-412f-b17b-2d45367ea438 => generated 1440 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:19:40 user devstack@n-api.service[61841]: ERROR oslo.messaging._drivers.impl_rabbit [-] [39e70ef5-6646-496c-bab9-1bdc9fdde40b] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 11:19:40 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:19:40 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:19:40 user devstack@n-api.service[61841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 11:19:40 user devstack@n-api.service[61841]: Fri Apr 14 11:19:40 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bfd4b9b2-a5fe-412f-b17b-2d45367ea438 (ip 10.0.0.210) !!! Apr 14 11:19:40 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:19:40 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=4 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:19:40 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-ca0b92cd-d90e-443b-b585-6c5982925845 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:19:40 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-ca0b92cd-d90e-443b-b585-6c5982925845 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:19:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ca0b92cd-d90e-443b-b585-6c5982925845 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:19:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ca0b92cd-d90e-443b-b585-6c5982925845 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:19:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ca0b92cd-d90e-443b-b585-6c5982925845 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:19:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ca0b92cd-d90e-443b-b585-6c5982925845 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:19:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ca0b92cd-d90e-443b-b585-6c5982925845 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:19:40 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-ca0b92cd-d90e-443b-b585-6c5982925845 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:19:41 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-ca0b92cd-d90e-443b-b585-6c5982925845 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:19:41 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-ca0b92cd-d90e-443b-b585-6c5982925845 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfd4b9b2-a5fe-412f-b17b-2d45367ea438" status: 200 len: 1440 microversion: 2.1 time: 0.245342 Apr 14 11:19:41 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 382/1134] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:19:40 2023] GET /compute/v2.1/servers/bfd4b9b2-a5fe-412f-b17b-2d45367ea438 => generated 1440 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:19:42 user devstack@n-api.service[61839]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ffdab63e-a9cf-438a-b5ad-27ebb2c3a1fd] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 11:19:42 user devstack@n-api.service[61839]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 11:19:42 user devstack@n-api.service[61839]: Fri Apr 14 11:19:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 11:19:42 user devstack@n-api.service[61839]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 11:19:42 user devstack@n-api.service[61839]: Fri Apr 14 11:19:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 11:19:42 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:19:42 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:19:42 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-e8aa924e-c373-4b2a-8cbf-987ff38ca4ca req-24d092d6-0feb-4bc0-9acf-de27b01a8558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfd4b9b2-a5fe-412f-b17b-2d45367ea438", "tag": "0c3004b4-2439-46a3-b5f9-67e77b319a70"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:19:42 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-e8aa924e-c373-4b2a-8cbf-987ff38ca4ca req-24d092d6-0feb-4bc0-9acf-de27b01a8558 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:19:42 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-e8aa924e-c373-4b2a-8cbf-987ff38ca4ca req-24d092d6-0feb-4bc0-9acf-de27b01a8558 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:19:42 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-e8aa924e-c373-4b2a-8cbf-987ff38ca4ca req-24d092d6-0feb-4bc0-9acf-de27b01a8558 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:19:42 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-e8aa924e-c373-4b2a-8cbf-987ff38ca4ca req-24d092d6-0feb-4bc0-9acf-de27b01a8558 service nova] Creating event network-changed:0c3004b4-2439-46a3-b5f9-67e77b319a70 for instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 on user Apr 14 11:19:42 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-e8aa924e-c373-4b2a-8cbf-987ff38ca4ca req-24d092d6-0feb-4bc0-9acf-de27b01a8558 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052254 Apr 14 11:19:42 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 373/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:19:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:19:49 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:19:49 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:19:49 user devstack@n-api.service[61840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 11:19:49 user devstack@n-api.service[61840]: Fri Apr 14 11:19:49 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 14 11:19:49 user devstack@n-api.service[61840]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 11:19:49 user devstack@n-api.service[61840]: Fri Apr 14 11:19:49 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 14 11:19:49 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1735930147", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-994193383", "security_groups": [{"name": "tempest-secgroup-smoke-1185924440"}], "block_device_mapping_v2": [{"uuid": "159b8c44-60ec-498e-8d1a-58a29ed9933b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32"}]}} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG nova.network.neutron [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] validate_networks() for [('6d6b6b35-b5ef-4d7c-abce-cad21cc99e32', None, None, None, None, None)] {{(pid=61840) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image limits 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image pref 0:0:0 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61840) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting quotas for project 2e7089cb52574f1daf7f578222bb7a67. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG nova.quota [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting quotas for user c7644d02bc784e4fb74ebaaceb3affe1 and project 2e7089cb52574f1daf7f578222bb7a67. Resources: {'cores', 'instances', 'ram'} {{(pid=61840) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Going to run 1 instances... {{(pid=61840) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 11:19:50 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='159b8c44-60ec-498e-8d1a-58a29ed9933b',volume_size=None,volume_type=None)] {{(pid=61840) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 11:19:50 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.863577 Apr 14 11:19:50 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 381/1136] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 11:19:49 2023] POST /compute/v2.1/servers => generated 404 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 11:19:50 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-124487e6-bb6f-4ac2-b54d-4a576d8f71e7 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:19:50 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-124487e6-bb6f-4ac2-b54d-4a576d8f71e7 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:19:50 user devstack@n-api.service[61841]: INFO oslo.messaging._drivers.impl_rabbit [-] [39e70ef5-6646-496c-bab9-1bdc9fdde40b] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 42438. Apr 14 11:19:50 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-124487e6-bb6f-4ac2-b54d-4a576d8f71e7 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:19:50 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-124487e6-bb6f-4ac2-b54d-4a576d8f71e7 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/774b8f7e-09d7-4e1e-8abd-371a280fb479" status: 200 len: 1089 microversion: 2.1 time: 0.074093 Apr 14 11:19:50 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 383/1137] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:19:50 2023] GET /compute/v2.1/servers/774b8f7e-09d7-4e1e-8abd-371a280fb479 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:19:53 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:19:53 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:19:53 user devstack@n-api.service[61839]: INFO oslo.messaging._drivers.impl_rabbit [-] [ffdab63e-a9cf-438a-b5ad-27ebb2c3a1fd] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 44446. Apr 14 11:19:53 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-6d99cf42-27b3-47cd-a6ec-ffb548e2df3c req-5f109995-4940-4086-b6d5-805e0a9b6032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "774b8f7e-09d7-4e1e-8abd-371a280fb479", "tag": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:19:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-6d99cf42-27b3-47cd-a6ec-ffb548e2df3c req-5f109995-4940-4086-b6d5-805e0a9b6032 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:19:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-6d99cf42-27b3-47cd-a6ec-ffb548e2df3c req-5f109995-4940-4086-b6d5-805e0a9b6032 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:19:53 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-6d99cf42-27b3-47cd-a6ec-ffb548e2df3c req-5f109995-4940-4086-b6d5-805e0a9b6032 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:19:53 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-6d99cf42-27b3-47cd-a6ec-ffb548e2df3c req-5f109995-4940-4086-b6d5-805e0a9b6032 service nova] Creating event network-changed:7a9e10e8-17b9-4d16-a55c-6073e39fc5ed for instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 on user Apr 14 11:19:53 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-6d99cf42-27b3-47cd-a6ec-ffb548e2df3c req-5f109995-4940-4086-b6d5-805e0a9b6032 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089054 Apr 14 11:19:53 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 374/1138] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:19:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:19:58 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-95b106fc-c30b-404e-9ab0-eebb3411c158 req-8d91095d-ac1f-4000-a846-b1931551d913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "774b8f7e-09d7-4e1e-8abd-371a280fb479", "name": "network-vif-plugged", "status": "completed", "tag": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:19:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-95b106fc-c30b-404e-9ab0-eebb3411c158 req-8d91095d-ac1f-4000-a846-b1931551d913 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:19:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-95b106fc-c30b-404e-9ab0-eebb3411c158 req-8d91095d-ac1f-4000-a846-b1931551d913 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:19:58 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-95b106fc-c30b-404e-9ab0-eebb3411c158 req-8d91095d-ac1f-4000-a846-b1931551d913 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:19:58 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-95b106fc-c30b-404e-9ab0-eebb3411c158 req-8d91095d-ac1f-4000-a846-b1931551d913 service nova] Creating event network-vif-plugged:7a9e10e8-17b9-4d16-a55c-6073e39fc5ed for instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 on user Apr 14 11:19:58 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-95b106fc-c30b-404e-9ab0-eebb3411c158 req-8d91095d-ac1f-4000-a846-b1931551d913 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030738 Apr 14 11:19:58 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 382/1139] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:19:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:20:01 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-e47a2983-8136-4827-a7a7-ea40758a1494 req-9b3b2d17-9c98-400c-98e2-67aabf348883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "774b8f7e-09d7-4e1e-8abd-371a280fb479", "name": "network-vif-plugged", "status": "completed", "tag": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:20:01 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:20:01 user devstack@n-api.service[61841]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 11:20:01 user devstack@n-api.service[61841]: Fri Apr 14 11:20:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 11:20:01 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:20:01 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell0:SELECT=2 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:20:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e47a2983-8136-4827-a7a7-ea40758a1494 req-9b3b2d17-9c98-400c-98e2-67aabf348883 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:20:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e47a2983-8136-4827-a7a7-ea40758a1494 req-9b3b2d17-9c98-400c-98e2-67aabf348883 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:20:01 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-e47a2983-8136-4827-a7a7-ea40758a1494 req-9b3b2d17-9c98-400c-98e2-67aabf348883 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:20:01 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-e47a2983-8136-4827-a7a7-ea40758a1494 req-9b3b2d17-9c98-400c-98e2-67aabf348883 service nova] Creating event network-vif-plugged:7a9e10e8-17b9-4d16-a55c-6073e39fc5ed for instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 on user Apr 14 11:20:01 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-e47a2983-8136-4827-a7a7-ea40758a1494 req-9b3b2d17-9c98-400c-98e2-67aabf348883 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043375 Apr 14 11:20:01 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 384/1140] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:20:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:20:40 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:20:40 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:20:40 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-02c165d8-06f7-4664-b552-ea8854572d11 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:20:40 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-02c165d8-06f7-4664-b552-ea8854572d11 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:20:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-02c165d8-06f7-4664-b552-ea8854572d11 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:20:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-02c165d8-06f7-4664-b552-ea8854572d11 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:20:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-02c165d8-06f7-4664-b552-ea8854572d11 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:20:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-02c165d8-06f7-4664-b552-ea8854572d11 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:20:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-02c165d8-06f7-4664-b552-ea8854572d11 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:20:40 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-02c165d8-06f7-4664-b552-ea8854572d11 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:20:40 user devstack@n-api.service[61839]: DEBUG nova.policy [None req-02c165d8-06f7-4664-b552-ea8854572d11 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61839) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:20:40 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-02c165d8-06f7-4664-b552-ea8854572d11 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/774b8f7e-09d7-4e1e-8abd-371a280fb479" status: 200 len: 1442 microversion: 2.1 time: 0.158362 Apr 14 11:20:40 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 375/1141] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:20:40 2023] GET /compute/v2.1/servers/774b8f7e-09d7-4e1e-8abd-371a280fb479 => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:21:41 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=2 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:21:41 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell0:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:21:41 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:21:41 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=4 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:21:41 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-115c5855-c1c2-44ec-9788-791e3ebf8c59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:21:41 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-115c5855-c1c2-44ec-9788-791e3ebf8c59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:21:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-115c5855-c1c2-44ec-9788-791e3ebf8c59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:21:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-115c5855-c1c2-44ec-9788-791e3ebf8c59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:21:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-115c5855-c1c2-44ec-9788-791e3ebf8c59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:21:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-115c5855-c1c2-44ec-9788-791e3ebf8c59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:21:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-115c5855-c1c2-44ec-9788-791e3ebf8c59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:21:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-115c5855-c1c2-44ec-9788-791e3ebf8c59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:21:41 user devstack@n-api.service[61840]: DEBUG nova.policy [None req-115c5855-c1c2-44ec-9788-791e3ebf8c59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61840) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:21:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-115c5855-c1c2-44ec-9788-791e3ebf8c59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/774b8f7e-09d7-4e1e-8abd-371a280fb479" status: 200 len: 1442 microversion: 2.1 time: 0.164587 Apr 14 11:21:41 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 383/1142] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:21:41 2023] GET /compute/v2.1/servers/774b8f7e-09d7-4e1e-8abd-371a280fb479 => generated 1442 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:21:43 user devstack@n-api.service[61841]: ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: timed out (retrying in 1.0 seconds): TimeoutError: timed out Apr 14 11:21:43 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-5e432465-0e6c-4c53-9fed-99f7b5e75789 req-3b380267-e226-452a-bb0e-8ba3a9871d7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "774b8f7e-09d7-4e1e-8abd-371a280fb479", "tag": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:21:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5e432465-0e6c-4c53-9fed-99f7b5e75789 req-3b380267-e226-452a-bb0e-8ba3a9871d7f service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:21:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5e432465-0e6c-4c53-9fed-99f7b5e75789 req-3b380267-e226-452a-bb0e-8ba3a9871d7f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:21:43 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-5e432465-0e6c-4c53-9fed-99f7b5e75789 req-3b380267-e226-452a-bb0e-8ba3a9871d7f service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:21:43 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-5e432465-0e6c-4c53-9fed-99f7b5e75789 req-3b380267-e226-452a-bb0e-8ba3a9871d7f service nova] Creating event network-changed:7a9e10e8-17b9-4d16-a55c-6073e39fc5ed for instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 on user Apr 14 11:21:43 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-5e432465-0e6c-4c53-9fed-99f7b5e75789 req-3b380267-e226-452a-bb0e-8ba3a9871d7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037849 Apr 14 11:21:43 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 385/1143] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:21:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:21:44 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=2 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:21:44 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=6 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:21:44 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:21:44 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:21:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:21:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:21:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:21:44 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-f296732c-8c86-42c5-b2b9-66306b76f78f req-ed7bb96d-9a3e-4e94-8cbb-312ef454ebcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "774b8f7e-09d7-4e1e-8abd-371a280fb479", "tag": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:21:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:21:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:21:44 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:21:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f296732c-8c86-42c5-b2b9-66306b76f78f req-ed7bb96d-9a3e-4e94-8cbb-312ef454ebcf service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:21:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f296732c-8c86-42c5-b2b9-66306b76f78f req-ed7bb96d-9a3e-4e94-8cbb-312ef454ebcf service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:21:44 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-f296732c-8c86-42c5-b2b9-66306b76f78f req-ed7bb96d-9a3e-4e94-8cbb-312ef454ebcf service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:21:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-f296732c-8c86-42c5-b2b9-66306b76f78f req-ed7bb96d-9a3e-4e94-8cbb-312ef454ebcf service nova] Creating event network-changed:7a9e10e8-17b9-4d16-a55c-6073e39fc5ed for instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 on user Apr 14 11:21:44 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Going to try to terminate instance {{(pid=61839) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:21:44 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-f296732c-8c86-42c5-b2b9-66306b76f78f req-ed7bb96d-9a3e-4e94-8cbb-312ef454ebcf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030032 Apr 14 11:21:44 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 384/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:21:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:21:44 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/774b8f7e-09d7-4e1e-8abd-371a280fb479" status: 204 len: 0 microversion: 2.1 time: 0.119294 Apr 14 11:21:44 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 376/1145] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:21:44 2023] DELETE /compute/v2.1/servers/774b8f7e-09d7-4e1e-8abd-371a280fb479 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:21:44 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-7279636b-a13d-4741-a571-1cfffcd3aef5 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:21:44 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-7279636b-a13d-4741-a571-1cfffcd3aef5 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:21:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7279636b-a13d-4741-a571-1cfffcd3aef5 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:21:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7279636b-a13d-4741-a571-1cfffcd3aef5 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:21:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7279636b-a13d-4741-a571-1cfffcd3aef5 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:21:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7279636b-a13d-4741-a571-1cfffcd3aef5 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:21:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7279636b-a13d-4741-a571-1cfffcd3aef5 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:21:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-7279636b-a13d-4741-a571-1cfffcd3aef5 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:21:44 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-7279636b-a13d-4741-a571-1cfffcd3aef5 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:21:44 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-7279636b-a13d-4741-a571-1cfffcd3aef5 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/774b8f7e-09d7-4e1e-8abd-371a280fb479" status: 200 len: 1567 microversion: 2.1 time: 0.235944 Apr 14 11:21:44 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 386/1146] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:21:44 2023] GET /compute/v2.1/servers/774b8f7e-09d7-4e1e-8abd-371a280fb479 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:21:45 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "774b8f7e-09d7-4e1e-8abd-371a280fb479", "name": "network-vif-unplugged", "status": "completed", "tag": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed"}, {"server_uuid": "774b8f7e-09d7-4e1e-8abd-371a280fb479", "name": "network-vif-plugged", "status": "completed", "tag": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:21:45 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:21:45 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:21:45 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:21:45 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] Creating event network-vif-unplugged:7a9e10e8-17b9-4d16-a55c-6073e39fc5ed for instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 on user Apr 14 11:21:45 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] Creating event network-vif-plugged:7a9e10e8-17b9-4d16-a55c-6073e39fc5ed for instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 on user Apr 14 11:21:45 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031037 Apr 14 11:21:45 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 385/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:21:45 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:21:46 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-bf7246da-5d45-49f7-a788-506de8bf532a req-8e840140-16df-498b-b237-c161519d0eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "774b8f7e-09d7-4e1e-8abd-371a280fb479", "name": "network-vif-deleted", "tag": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:21:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-bf7246da-5d45-49f7-a788-506de8bf532a req-8e840140-16df-498b-b237-c161519d0eef service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:21:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-bf7246da-5d45-49f7-a788-506de8bf532a req-8e840140-16df-498b-b237-c161519d0eef service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:21:46 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-bf7246da-5d45-49f7-a788-506de8bf532a req-8e840140-16df-498b-b237-c161519d0eef service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:21:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-bf7246da-5d45-49f7-a788-506de8bf532a req-8e840140-16df-498b-b237-c161519d0eef service nova] Creating event network-vif-deleted:7a9e10e8-17b9-4d16-a55c-6073e39fc5ed for instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 on user Apr 14 11:21:46 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-bf7246da-5d45-49f7-a788-506de8bf532a req-8e840140-16df-498b-b237-c161519d0eef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030509 Apr 14 11:21:46 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 377/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:21:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:22:34 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:22:34 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=10 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:22:34 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e3729735-9380-4268-bb8b-303d6debb1bd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:22:34 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-e3729735-9380-4268-bb8b-303d6debb1bd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:22:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e3729735-9380-4268-bb8b-303d6debb1bd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:22:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e3729735-9380-4268-bb8b-303d6debb1bd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:22:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e3729735-9380-4268-bb8b-303d6debb1bd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:22:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e3729735-9380-4268-bb8b-303d6debb1bd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:22:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e3729735-9380-4268-bb8b-303d6debb1bd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:22:34 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-e3729735-9380-4268-bb8b-303d6debb1bd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:22:34 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-e3729735-9380-4268-bb8b-303d6debb1bd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HTTP exception thrown: Instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 could not be found. Apr 14 11:22:34 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e3729735-9380-4268-bb8b-303d6debb1bd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Request method failure captured: Apr 14 11:22:34 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/774b8f7e-09d7-4e1e-8abd-371a280fb479 HTTP/1.1 Apr 14 11:22:34 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:22:34 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:22:34 user devstack@n-api.service[61841]: Connection: close Apr 14 11:22:34 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:22:34 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:22:34 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:22:34 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:22:34 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:22:34 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOTOscq830xumO0pE4afr8hOrEKJzznUYbYP-3SI3ny-DA6kv_rRe3G7iAHsQdncX43dMQiRCf9NWDRZowvTbgHtZlJuzDm2z8bxhcIzBRIAVlefTNB4nKwb-zSZ6OMRbbxZzKV1NmP0nkTSlvsXvb4bIOP4rVsUvjkb-NM520Xm7GX4 Apr 14 11:22:34 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:22:34 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:22:34 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:22:34 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:22:34 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:22:34 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:22:34 user devstack@n-api.service[61841]: X-Project-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:22:34 user devstack@n-api.service[61841]: X-Project-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:22:34 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:22:34 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:22:34 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}] Apr 14 11:22:34 user devstack@n-api.service[61841]: X-Tenant: tempest-TestVolumeBootPattern-193101874 Apr 14 11:22:34 user devstack@n-api.service[61841]: X-Tenant-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:22:34 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:22:34 user devstack@n-api.service[61841]: X-User: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:22:34 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:22:34 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:22:34 user devstack@n-api.service[61841]: X-User-Id: c7644d02bc784e4fb74ebaaceb3affe1 Apr 14 11:22:34 user devstack@n-api.service[61841]: X-User-Name: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:22:34 user devstack@n-api.service[61841]: method: > Apr 14 11:22:34 user devstack@n-api.service[61841]: exception: Instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 could not be found. Apr 14 11:22:34 user devstack@n-api.service[61841]: action_args: {'id': '774b8f7e-09d7-4e1e-8abd-371a280fb479'} Apr 14 11:22:34 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 could not be found. Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 could not be found. Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 could not be found. Apr 14 11:22:34 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:22:34 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-e3729735-9380-4268-bb8b-303d6debb1bd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Returning 404 to user: Instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:22:34 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-e3729735-9380-4268-bb8b-303d6debb1bd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/774b8f7e-09d7-4e1e-8abd-371a280fb479" status: 404 len: 111 microversion: 2.1 time: 0.093245 Apr 14 11:22:34 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 387/1149] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:22:34 2023] GET /compute/v2.1/servers/774b8f7e-09d7-4e1e-8abd-371a280fb479 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:22:41 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=6 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:22:41 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=10 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:22:41 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:22:41 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:22:41 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:22:41 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:22:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:22:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:22:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:22:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:22:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:22:41 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:22:41 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Going to try to terminate instance {{(pid=61840) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 11:22:41 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-8142bd3c-89e6-46f6-8313-10111bc02a98 req-42ba8012-485f-4096-b56d-868377458744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfd4b9b2-a5fe-412f-b17b-2d45367ea438", "tag": "0c3004b4-2439-46a3-b5f9-67e77b319a70"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:22:41 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bfd4b9b2-a5fe-412f-b17b-2d45367ea438" status: 204 len: 0 microversion: 2.1 time: 0.124698 Apr 14 11:22:41 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 386/1150] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:22:41 2023] DELETE /compute/v2.1/servers/bfd4b9b2-a5fe-412f-b17b-2d45367ea438 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 11:22:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8142bd3c-89e6-46f6-8313-10111bc02a98 req-42ba8012-485f-4096-b56d-868377458744 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:22:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8142bd3c-89e6-46f6-8313-10111bc02a98 req-42ba8012-485f-4096-b56d-868377458744 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:22:41 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-8142bd3c-89e6-46f6-8313-10111bc02a98 req-42ba8012-485f-4096-b56d-868377458744 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:22:41 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-5c75c18a-7d86-4539-ae1f-f9abac4799af tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:22:41 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-5c75c18a-7d86-4539-ae1f-f9abac4799af tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:22:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5c75c18a-7d86-4539-ae1f-f9abac4799af tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:22:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5c75c18a-7d86-4539-ae1f-f9abac4799af tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:22:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5c75c18a-7d86-4539-ae1f-f9abac4799af tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:22:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5c75c18a-7d86-4539-ae1f-f9abac4799af tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:22:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5c75c18a-7d86-4539-ae1f-f9abac4799af tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:22:41 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-5c75c18a-7d86-4539-ae1f-f9abac4799af tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:22:41 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-8142bd3c-89e6-46f6-8313-10111bc02a98 req-42ba8012-485f-4096-b56d-868377458744 service nova] Creating event network-changed:0c3004b4-2439-46a3-b5f9-67e77b319a70 for instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 on user Apr 14 11:22:41 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-8142bd3c-89e6-46f6-8313-10111bc02a98 req-42ba8012-485f-4096-b56d-868377458744 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152945 Apr 14 11:22:41 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 378/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:22:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:22:42 user devstack@n-api.service[61841]: DEBUG nova.policy [None req-5c75c18a-7d86-4539-ae1f-f9abac4799af tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61841) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 11:22:42 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-5c75c18a-7d86-4539-ae1f-f9abac4799af tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfd4b9b2-a5fe-412f-b17b-2d45367ea438" status: 200 len: 1565 microversion: 2.1 time: 0.189067 Apr 14 11:22:42 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 388/1152] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:22:41 2023] GET /compute/v2.1/servers/bfd4b9b2-a5fe-412f-b17b-2d45367ea438 => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 11:22:42 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [req-3285354e-3eb6-45a8-8945-c3069bbc9d9e req-f36dce00-b88f-47e2-9ffb-661d622a7f58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd4b9b2-a5fe-412f-b17b-2d45367ea438", "name": "network-vif-unplugged", "status": "completed", "tag": "0c3004b4-2439-46a3-b5f9-67e77b319a70"}]} {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:22:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-3285354e-3eb6-45a8-8945-c3069bbc9d9e req-f36dce00-b88f-47e2-9ffb-661d622a7f58 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:22:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-3285354e-3eb6-45a8-8945-c3069bbc9d9e req-f36dce00-b88f-47e2-9ffb-661d622a7f58 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:22:42 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [req-3285354e-3eb6-45a8-8945-c3069bbc9d9e req-f36dce00-b88f-47e2-9ffb-661d622a7f58 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:22:42 user devstack@n-api.service[61840]: INFO nova.api.openstack.compute.server_external_events [req-3285354e-3eb6-45a8-8945-c3069bbc9d9e req-f36dce00-b88f-47e2-9ffb-661d622a7f58 service nova] Creating event network-vif-unplugged:0c3004b4-2439-46a3-b5f9-67e77b319a70 for instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 on user Apr 14 11:22:42 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [req-3285354e-3eb6-45a8-8945-c3069bbc9d9e req-f36dce00-b88f-47e2-9ffb-661d622a7f58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027669 Apr 14 11:22:42 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 387/1153] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:22:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:22:43 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [req-4b2f77b1-c4ac-420d-95d4-8d8e2668d374 req-237bb841-5f9f-48c5-8810-15f6f16db7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd4b9b2-a5fe-412f-b17b-2d45367ea438", "name": "network-vif-deleted", "tag": "0c3004b4-2439-46a3-b5f9-67e77b319a70"}]} {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:22:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4b2f77b1-c4ac-420d-95d4-8d8e2668d374 req-237bb841-5f9f-48c5-8810-15f6f16db7a8 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:22:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4b2f77b1-c4ac-420d-95d4-8d8e2668d374 req-237bb841-5f9f-48c5-8810-15f6f16db7a8 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:22:43 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [req-4b2f77b1-c4ac-420d-95d4-8d8e2668d374 req-237bb841-5f9f-48c5-8810-15f6f16db7a8 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:22:43 user devstack@n-api.service[61839]: INFO nova.api.openstack.compute.server_external_events [req-4b2f77b1-c4ac-420d-95d4-8d8e2668d374 req-237bb841-5f9f-48c5-8810-15f6f16db7a8 service nova] Creating event network-vif-deleted:0c3004b4-2439-46a3-b5f9-67e77b319a70 for instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 on user Apr 14 11:22:43 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [req-4b2f77b1-c4ac-420d-95d4-8d8e2668d374 req-237bb841-5f9f-48c5-8810-15f6f16db7a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035173 Apr 14 11:22:43 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 379/1154] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:22:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:22:44 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [req-0ba91f3a-005c-4b39-8de2-e8aef9b7e0bc req-17546989-2839-456d-b5b8-e8d62fab9451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfd4b9b2-a5fe-412f-b17b-2d45367ea438", "name": "network-vif-plugged", "status": "completed", "tag": "0c3004b4-2439-46a3-b5f9-67e77b319a70"}]} {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 11:22:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-0ba91f3a-005c-4b39-8de2-e8aef9b7e0bc req-17546989-2839-456d-b5b8-e8d62fab9451 service nova] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:22:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-0ba91f3a-005c-4b39-8de2-e8aef9b7e0bc req-17546989-2839-456d-b5b8-e8d62fab9451 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:22:44 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [req-0ba91f3a-005c-4b39-8de2-e8aef9b7e0bc req-17546989-2839-456d-b5b8-e8d62fab9451 service nova] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:22:44 user devstack@n-api.service[61841]: INFO nova.api.openstack.compute.server_external_events [req-0ba91f3a-005c-4b39-8de2-e8aef9b7e0bc req-17546989-2839-456d-b5b8-e8d62fab9451 service nova] Creating event network-vif-plugged:0c3004b4-2439-46a3-b5f9-67e77b319a70 for instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 on user Apr 14 11:22:44 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [req-0ba91f3a-005c-4b39-8de2-e8aef9b7e0bc req-17546989-2839-456d-b5b8-e8d62fab9451 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029471 Apr 14 11:22:44 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 389/1155] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 11:22:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 11:23:32 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:23:32 user devstack@n-api.service[61840]: DEBUG dbcounter [-] [61840] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61840) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:23:32 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-248f89f5-0f28-42e0-b8b7-0e9584cc5520 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:23:32 user devstack@n-api.service[61840]: DEBUG nova.compute.api [None req-248f89f5-0f28-42e0-b8b7-0e9584cc5520 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Fetching instance by UUID {{(pid=61840) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:23:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-248f89f5-0f28-42e0-b8b7-0e9584cc5520 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:23:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-248f89f5-0f28-42e0-b8b7-0e9584cc5520 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:23:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-248f89f5-0f28-42e0-b8b7-0e9584cc5520 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:23:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-248f89f5-0f28-42e0-b8b7-0e9584cc5520 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:23:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-248f89f5-0f28-42e0-b8b7-0e9584cc5520 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:23:32 user devstack@n-api.service[61840]: DEBUG oslo_concurrency.lockutils [None req-248f89f5-0f28-42e0-b8b7-0e9584cc5520 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61840) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:23:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.wsgi [None req-248f89f5-0f28-42e0-b8b7-0e9584cc5520 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HTTP exception thrown: Instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 could not be found. Apr 14 11:23:32 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-248f89f5-0f28-42e0-b8b7-0e9584cc5520 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Request method failure captured: Apr 14 11:23:32 user devstack@n-api.service[61840]: request: GET /compute/v2.1/servers/bfd4b9b2-a5fe-412f-b17b-2d45367ea438 HTTP/1.1 Apr 14 11:23:32 user devstack@n-api.service[61840]: Accept: application/json Apr 14 11:23:32 user devstack@n-api.service[61840]: Accept-Encoding: identity Apr 14 11:23:32 user devstack@n-api.service[61840]: Connection: close Apr 14 11:23:32 user devstack@n-api.service[61840]: Content-Length: 0 Apr 14 11:23:32 user devstack@n-api.service[61840]: Content-Type: application/json Apr 14 11:23:32 user devstack@n-api.service[61840]: Host: 10.0.0.210 Apr 14 11:23:32 user devstack@n-api.service[61840]: Openstack-System-Scope: None Apr 14 11:23:32 user devstack@n-api.service[61840]: User-Agent: python-urllib3/1.26.15 Apr 14 11:23:32 user devstack@n-api.service[61840]: X-Auth-Token: gAAAAABkOTOscq830xumO0pE4afr8hOrEKJzznUYbYP-3SI3ny-DA6kv_rRe3G7iAHsQdncX43dMQiRCf9NWDRZowvTbgHtZlJuzDm2z8bxhcIzBRIAVlefTNB4nKwb-zSZ6OMRbbxZzKV1NmP0nkTSlvsXvb4bIOP4rVsUvjkb-NM520Xm7GX4 Apr 14 11:23:32 user devstack@n-api.service[61840]: X-Domain-Id: None Apr 14 11:23:32 user devstack@n-api.service[61840]: X-Domain-Name: None Apr 14 11:23:32 user devstack@n-api.service[61840]: X-Identity-Status: Confirmed Apr 14 11:23:32 user devstack@n-api.service[61840]: X-Is-Admin-Project: True Apr 14 11:23:32 user devstack@n-api.service[61840]: X-Project-Domain-Id: default Apr 14 11:23:32 user devstack@n-api.service[61840]: X-Project-Domain-Name: Default Apr 14 11:23:32 user devstack@n-api.service[61840]: X-Project-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:23:32 user devstack@n-api.service[61840]: X-Project-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:23:32 user devstack@n-api.service[61840]: X-Role: member,reader Apr 14 11:23:32 user devstack@n-api.service[61840]: X-Roles: member,reader Apr 14 11:23:32 user devstack@n-api.service[61840]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}] Apr 14 11:23:32 user devstack@n-api.service[61840]: X-Tenant: tempest-TestVolumeBootPattern-193101874 Apr 14 11:23:32 user devstack@n-api.service[61840]: X-Tenant-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:23:32 user devstack@n-api.service[61840]: X-Tenant-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:23:32 user devstack@n-api.service[61840]: X-User: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:23:32 user devstack@n-api.service[61840]: X-User-Domain-Id: default Apr 14 11:23:32 user devstack@n-api.service[61840]: X-User-Domain-Name: Default Apr 14 11:23:32 user devstack@n-api.service[61840]: X-User-Id: c7644d02bc784e4fb74ebaaceb3affe1 Apr 14 11:23:32 user devstack@n-api.service[61840]: X-User-Name: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:23:32 user devstack@n-api.service[61840]: method: > Apr 14 11:23:32 user devstack@n-api.service[61840]: exception: Instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 could not be found. Apr 14 11:23:32 user devstack@n-api.service[61840]: action_args: {'id': 'bfd4b9b2-a5fe-412f-b17b-2d45367ea438'} Apr 14 11:23:32 user devstack@n-api.service[61840]: {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 could not be found. Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 could not be found. Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 could not be found. Apr 14 11:23:32 user devstack@n-api.service[61840]: ERROR nova.api.openstack.wsgi Apr 14 11:23:32 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-248f89f5-0f28-42e0-b8b7-0e9584cc5520 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Returning 404 to user: Instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 could not be found. {{(pid=61840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:23:32 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-248f89f5-0f28-42e0-b8b7-0e9584cc5520 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfd4b9b2-a5fe-412f-b17b-2d45367ea438" status: 404 len: 111 microversion: 2.1 time: 0.039306 Apr 14 11:23:32 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 388/1156] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:23:32 2023] GET /compute/v2.1/servers/bfd4b9b2-a5fe-412f-b17b-2d45367ea438 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:23:33 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_api:SELECT=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:23:33 user devstack@n-api.service[61839]: DEBUG dbcounter [-] [61839] Writing DB stats nova_cell1:SELECT=4 {{(pid=61839) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:23:33 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-398995b2-be69-4820-aa92-2230a3b026c8 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:23:33 user devstack@n-api.service[61839]: DEBUG nova.compute.api [None req-398995b2-be69-4820-aa92-2230a3b026c8 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Fetching instance by UUID {{(pid=61839) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:23:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-398995b2-be69-4820-aa92-2230a3b026c8 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:23:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-398995b2-be69-4820-aa92-2230a3b026c8 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:23:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-398995b2-be69-4820-aa92-2230a3b026c8 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:23:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-398995b2-be69-4820-aa92-2230a3b026c8 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:23:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-398995b2-be69-4820-aa92-2230a3b026c8 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:23:33 user devstack@n-api.service[61839]: DEBUG oslo_concurrency.lockutils [None req-398995b2-be69-4820-aa92-2230a3b026c8 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61839) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:23:33 user devstack@n-api.service[61839]: INFO nova.api.openstack.wsgi [None req-398995b2-be69-4820-aa92-2230a3b026c8 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HTTP exception thrown: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. Apr 14 11:23:33 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-398995b2-be69-4820-aa92-2230a3b026c8 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Request method failure captured: Apr 14 11:23:33 user devstack@n-api.service[61839]: request: DELETE /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f HTTP/1.1 Apr 14 11:23:33 user devstack@n-api.service[61839]: Accept: application/json Apr 14 11:23:33 user devstack@n-api.service[61839]: Accept-Encoding: identity Apr 14 11:23:33 user devstack@n-api.service[61839]: Connection: close Apr 14 11:23:33 user devstack@n-api.service[61839]: Content-Length: 0 Apr 14 11:23:33 user devstack@n-api.service[61839]: Content-Type: application/json Apr 14 11:23:33 user devstack@n-api.service[61839]: Host: 10.0.0.210 Apr 14 11:23:33 user devstack@n-api.service[61839]: Openstack-System-Scope: None Apr 14 11:23:33 user devstack@n-api.service[61839]: User-Agent: python-urllib3/1.26.15 Apr 14 11:23:33 user devstack@n-api.service[61839]: X-Auth-Token: gAAAAABkOTOscq830xumO0pE4afr8hOrEKJzznUYbYP-3SI3ny-DA6kv_rRe3G7iAHsQdncX43dMQiRCf9NWDRZowvTbgHtZlJuzDm2z8bxhcIzBRIAVlefTNB4nKwb-zSZ6OMRbbxZzKV1NmP0nkTSlvsXvb4bIOP4rVsUvjkb-NM520Xm7GX4 Apr 14 11:23:33 user devstack@n-api.service[61839]: X-Domain-Id: None Apr 14 11:23:33 user devstack@n-api.service[61839]: X-Domain-Name: None Apr 14 11:23:33 user devstack@n-api.service[61839]: X-Identity-Status: Confirmed Apr 14 11:23:33 user devstack@n-api.service[61839]: X-Is-Admin-Project: True Apr 14 11:23:33 user devstack@n-api.service[61839]: X-Project-Domain-Id: default Apr 14 11:23:33 user devstack@n-api.service[61839]: X-Project-Domain-Name: Default Apr 14 11:23:33 user devstack@n-api.service[61839]: X-Project-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:23:33 user devstack@n-api.service[61839]: X-Project-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:23:33 user devstack@n-api.service[61839]: X-Role: member,reader Apr 14 11:23:33 user devstack@n-api.service[61839]: X-Roles: member,reader Apr 14 11:23:33 user devstack@n-api.service[61839]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}] Apr 14 11:23:33 user devstack@n-api.service[61839]: X-Tenant: tempest-TestVolumeBootPattern-193101874 Apr 14 11:23:33 user devstack@n-api.service[61839]: X-Tenant-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:23:33 user devstack@n-api.service[61839]: X-Tenant-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:23:33 user devstack@n-api.service[61839]: X-User: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:23:33 user devstack@n-api.service[61839]: X-User-Domain-Id: default Apr 14 11:23:33 user devstack@n-api.service[61839]: X-User-Domain-Name: Default Apr 14 11:23:33 user devstack@n-api.service[61839]: X-User-Id: c7644d02bc784e4fb74ebaaceb3affe1 Apr 14 11:23:33 user devstack@n-api.service[61839]: X-User-Name: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:23:33 user devstack@n-api.service[61839]: method: > Apr 14 11:23:33 user devstack@n-api.service[61839]: exception: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. Apr 14 11:23:33 user devstack@n-api.service[61839]: action_args: {'id': '3c4d3f81-5c17-4116-819b-84cefb35336f'} Apr 14 11:23:33 user devstack@n-api.service[61839]: {{(pid=61839) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. Apr 14 11:23:33 user devstack@n-api.service[61839]: ERROR nova.api.openstack.wsgi Apr 14 11:23:33 user devstack@n-api.service[61839]: DEBUG nova.api.openstack.wsgi [None req-398995b2-be69-4820-aa92-2230a3b026c8 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Returning 404 to user: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. {{(pid=61839) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:23:33 user devstack@n-api.service[61839]: INFO nova.api.openstack.requestlog [None req-398995b2-be69-4820-aa92-2230a3b026c8 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f" status: 404 len: 111 microversion: 2.1 time: 0.038950 Apr 14 11:23:33 user devstack@n-api.service[61839]: [pid: 61839|app: 0|req: 380/1157] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 11:23:33 2023] DELETE /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:23:33 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_api:SELECT=6 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:23:33 user devstack@n-api.service[61841]: DEBUG dbcounter [-] [61841] Writing DB stats nova_cell1:SELECT=10 {{(pid=61841) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 11:23:33 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-700041b7-ed3f-4ed1-a153-2a0dd44f6d36 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '>' {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:23:33 user devstack@n-api.service[61841]: DEBUG nova.compute.api [None req-700041b7-ed3f-4ed1-a153-2a0dd44f6d36 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Fetching instance by UUID {{(pid=61841) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 11:23:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-700041b7-ed3f-4ed1-a153-2a0dd44f6d36 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:23:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-700041b7-ed3f-4ed1-a153-2a0dd44f6d36 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:23:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-700041b7-ed3f-4ed1-a153-2a0dd44f6d36 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:23:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-700041b7-ed3f-4ed1-a153-2a0dd44f6d36 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 11:23:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-700041b7-ed3f-4ed1-a153-2a0dd44f6d36 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 11:23:33 user devstack@n-api.service[61841]: DEBUG oslo_concurrency.lockutils [None req-700041b7-ed3f-4ed1-a153-2a0dd44f6d36 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "93e1f09b-7316-4d89-8ce4-b495a7808f8e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61841) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 11:23:33 user devstack@n-api.service[61841]: INFO nova.api.openstack.wsgi [None req-700041b7-ed3f-4ed1-a153-2a0dd44f6d36 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HTTP exception thrown: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. Apr 14 11:23:33 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-700041b7-ed3f-4ed1-a153-2a0dd44f6d36 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Request method failure captured: Apr 14 11:23:33 user devstack@n-api.service[61841]: request: GET /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f HTTP/1.1 Apr 14 11:23:33 user devstack@n-api.service[61841]: Accept: application/json Apr 14 11:23:33 user devstack@n-api.service[61841]: Accept-Encoding: identity Apr 14 11:23:33 user devstack@n-api.service[61841]: Connection: close Apr 14 11:23:33 user devstack@n-api.service[61841]: Content-Length: 0 Apr 14 11:23:33 user devstack@n-api.service[61841]: Content-Type: application/json Apr 14 11:23:33 user devstack@n-api.service[61841]: Host: 10.0.0.210 Apr 14 11:23:33 user devstack@n-api.service[61841]: Openstack-System-Scope: None Apr 14 11:23:33 user devstack@n-api.service[61841]: User-Agent: python-urllib3/1.26.15 Apr 14 11:23:33 user devstack@n-api.service[61841]: X-Auth-Token: gAAAAABkOTOscq830xumO0pE4afr8hOrEKJzznUYbYP-3SI3ny-DA6kv_rRe3G7iAHsQdncX43dMQiRCf9NWDRZowvTbgHtZlJuzDm2z8bxhcIzBRIAVlefTNB4nKwb-zSZ6OMRbbxZzKV1NmP0nkTSlvsXvb4bIOP4rVsUvjkb-NM520Xm7GX4 Apr 14 11:23:33 user devstack@n-api.service[61841]: X-Domain-Id: None Apr 14 11:23:33 user devstack@n-api.service[61841]: X-Domain-Name: None Apr 14 11:23:33 user devstack@n-api.service[61841]: X-Identity-Status: Confirmed Apr 14 11:23:33 user devstack@n-api.service[61841]: X-Is-Admin-Project: True Apr 14 11:23:33 user devstack@n-api.service[61841]: X-Project-Domain-Id: default Apr 14 11:23:33 user devstack@n-api.service[61841]: X-Project-Domain-Name: Default Apr 14 11:23:33 user devstack@n-api.service[61841]: X-Project-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:23:33 user devstack@n-api.service[61841]: X-Project-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:23:33 user devstack@n-api.service[61841]: X-Role: member,reader Apr 14 11:23:33 user devstack@n-api.service[61841]: X-Roles: member,reader Apr 14 11:23:33 user devstack@n-api.service[61841]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2e7089cb52574f1daf7f578222bb7a67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2e7089cb52574f1daf7f578222bb7a67"}]}] Apr 14 11:23:33 user devstack@n-api.service[61841]: X-Tenant: tempest-TestVolumeBootPattern-193101874 Apr 14 11:23:33 user devstack@n-api.service[61841]: X-Tenant-Id: 2e7089cb52574f1daf7f578222bb7a67 Apr 14 11:23:33 user devstack@n-api.service[61841]: X-Tenant-Name: tempest-TestVolumeBootPattern-193101874 Apr 14 11:23:33 user devstack@n-api.service[61841]: X-User: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:23:33 user devstack@n-api.service[61841]: X-User-Domain-Id: default Apr 14 11:23:33 user devstack@n-api.service[61841]: X-User-Domain-Name: Default Apr 14 11:23:33 user devstack@n-api.service[61841]: X-User-Id: c7644d02bc784e4fb74ebaaceb3affe1 Apr 14 11:23:33 user devstack@n-api.service[61841]: X-User-Name: tempest-TestVolumeBootPattern-193101874-project-member Apr 14 11:23:33 user devstack@n-api.service[61841]: method: > Apr 14 11:23:33 user devstack@n-api.service[61841]: exception: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. Apr 14 11:23:33 user devstack@n-api.service[61841]: action_args: {'id': '3c4d3f81-5c17-4116-819b-84cefb35336f'} Apr 14 11:23:33 user devstack@n-api.service[61841]: {{(pid=61841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. Apr 14 11:23:33 user devstack@n-api.service[61841]: ERROR nova.api.openstack.wsgi Apr 14 11:23:33 user devstack@n-api.service[61841]: DEBUG nova.api.openstack.wsgi [None req-700041b7-ed3f-4ed1-a153-2a0dd44f6d36 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Returning 404 to user: Instance 3c4d3f81-5c17-4116-819b-84cefb35336f could not be found. {{(pid=61841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 11:23:33 user devstack@n-api.service[61841]: INFO nova.api.openstack.requestlog [None req-700041b7-ed3f-4ed1-a153-2a0dd44f6d36 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f" status: 404 len: 111 microversion: 2.1 time: 0.034274 Apr 14 11:23:33 user devstack@n-api.service[61841]: [pid: 61841|app: 0|req: 390/1158] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 11:23:33 2023] GET /compute/v2.1/servers/3c4d3f81-5c17-4116-819b-84cefb35336f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 11:23:36 user devstack@n-api.service[61840]: DEBUG nova.api.openstack.wsgi [None req-ce795527-d001-4b0d-9c41-54490db7b8e7 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Calling method '.version_select at 0x7fcd1ce45fc0>' {{(pid=61840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 11:23:36 user devstack@n-api.service[61840]: INFO nova.api.openstack.requestlog [None req-ce795527-d001-4b0d-9c41-54490db7b8e7 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-994193383" status: 202 len: 0 microversion: 2.1 time: 0.030077 Apr 14 11:23:36 user devstack@n-api.service[61840]: [pid: 61840|app: 0|req: 389/1159] 10.0.0.210 () {62 vars in 1337 bytes} [Fri Apr 14 11:23:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-994193383 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)